2018-11-29 13:25:02 [DEBUG   ] Got command BAM from MCS: ref #665640
2018-11-29 13:25:02 [INFO    ] Finished processing BAM request
2018-11-29 13:25:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665640   8 58451 48302033 A  ERROR'
2018-11-29 13:25:02 [DEBUG   ] Got command BAM from MCS: ref #665639
2018-11-29 13:25:02 [INFO    ] Finished processing BAM request
2018-11-29 13:25:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665639   8 58451 48302041 A  ERROR'
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:25:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:25:02 [DEBUG   ] spawn_process: at 2018-11-29 13:25:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:25:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:25:26 [DEBUG   ] Got command BAM from MCS: ref #665641
2018-11-29 13:25:26 [INFO    ] Finished processing BAM request
2018-11-29 13:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665641   8 58451 48326029 A  ERROR'
2018-11-29 13:25:26 [DEBUG   ] Got command BAM from MCS: ref #665642
2018-11-29 13:25:26 [INFO    ] Finished processing BAM request
2018-11-29 13:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665642   8 58451 48326033 A  ERROR'
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:25:26 [DEBUG   ] spawn_process: at 2018-11-29 13:25:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:25:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 13:25:49 [DEBUG   ] Got command RPT from MCS: ref #665645
2018-11-29 13:25:49 [DEBUG   ] summary = ERROR
2018-11-29 13:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665645  13 58451 48349685 A  ERRORERROR'
2018-11-29 13:25:49 [DEBUG   ] Got command RPT from MCS: ref #665646
2018-11-29 13:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665646  77 58451 48349686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:25:50 [DEBUG   ] Got command BAM from MCS: ref #665644
2018-11-29 13:25:50 [INFO    ] Finished processing BAM request
2018-11-29 13:25:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:25:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665644   8 58451 48350025 A  ERROR'
2018-11-29 13:25:50 [DEBUG   ] Got command BAM from MCS: ref #665643
2018-11-29 13:25:50 [INFO    ] Finished processing BAM request
2018-11-29 13:25:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:25:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665643   8 58451 48350029 A  ERROR'
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:25:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:25:50 [DEBUG   ] spawn_process: at 2018-11-29 13:25:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:25:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 13:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 13:25:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:25:58 [DEBUG   ] Finished updating board flags in 1.916 seconds
2018-11-29 13:26:14 [DEBUG   ] Got command BAM from MCS: ref #665667
2018-11-29 13:26:14 [INFO    ] Finished processing BAM request
2018-11-29 13:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665667   8 58451 48374025 A  ERROR'
2018-11-29 13:26:14 [DEBUG   ] Got command BAM from MCS: ref #665666
2018-11-29 13:26:14 [INFO    ] Finished processing BAM request
2018-11-29 13:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665666   8 58451 48374029 A  ERROR'
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:26:14 [DEBUG   ] spawn_process: at 2018-11-29 13:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:26:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:26:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 13:26:38 [DEBUG   ] Got command BAM from MCS: ref #665668
2018-11-29 13:26:38 [INFO    ] Finished processing BAM request
2018-11-29 13:26:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665668   8 58451 48398033 A  ERROR'
2018-11-29 13:26:38 [DEBUG   ] Got command BAM from MCS: ref #665669
2018-11-29 13:26:38 [INFO    ] Finished processing BAM request
2018-11-29 13:26:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665669   8 58451 48398037 A  ERROR'
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:26:38 [DEBUG   ] spawn_process: at 2018-11-29 13:26:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:26:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 13:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 13:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:26:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:26:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:26:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:26:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:26:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:26:57 [DEBUG   ] Finished updating board flags in 1.244 seconds
2018-11-29 13:27:02 [DEBUG   ] Got command BAM from MCS: ref #665670
2018-11-29 13:27:02 [INFO    ] Finished processing BAM request
2018-11-29 13:27:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665670   8 58451 48422033 A  ERROR'
2018-11-29 13:27:02 [DEBUG   ] Got command BAM from MCS: ref #665671
2018-11-29 13:27:02 [INFO    ] Finished processing BAM request
2018-11-29 13:27:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665671   8 58451 48422037 A  ERROR'
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:27:02 [DEBUG   ] spawn_process: at 2018-11-29 13:27:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:27:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 13:27:26 [DEBUG   ] Got command BAM from MCS: ref #665673
2018-11-29 13:27:26 [INFO    ] Finished processing BAM request
2018-11-29 13:27:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665673   8 58451 48446033 A  ERROR'
2018-11-29 13:27:26 [DEBUG   ] Got command BAM from MCS: ref #665672
2018-11-29 13:27:26 [INFO    ] Finished processing BAM request
2018-11-29 13:27:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665672   8 58451 48446037 A  ERROR'
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:27:26 [DEBUG   ] spawn_process: at 2018-11-29 13:27:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:27:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:27:50 [DEBUG   ] Got command BAM from MCS: ref #665675
2018-11-29 13:27:50 [INFO    ] Finished processing BAM request
2018-11-29 13:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665675   8 58451 48470025 A  ERROR'
2018-11-29 13:27:50 [DEBUG   ] Got command BAM from MCS: ref #665674
2018-11-29 13:27:50 [INFO    ] Finished processing BAM request
2018-11-29 13:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665674   8 58451 48470029 A  ERROR'
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:27:50 [DEBUG   ] spawn_process: at 2018-11-29 13:27:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:27:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:27:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:27:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:27:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:27:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:27:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:27:57 [DEBUG   ] Finished updating board flags in 1.224 seconds
2018-11-29 13:28:14 [DEBUG   ] Got command BAM from MCS: ref #665676
2018-11-29 13:28:14 [INFO    ] Finished processing BAM request
2018-11-29 13:28:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665676   8 58451 48494025 A  ERROR'
2018-11-29 13:28:14 [DEBUG   ] Got command BAM from MCS: ref #665677
2018-11-29 13:28:14 [INFO    ] Finished processing BAM request
2018-11-29 13:28:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665677   8 58451 48494029 A  ERROR'
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:28:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:28:14 [DEBUG   ] spawn_process: at 2018-11-29 13:28:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:28:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:28:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:28:38 [DEBUG   ] Got command BAM from MCS: ref #665679
2018-11-29 13:28:38 [INFO    ] Finished processing BAM request
2018-11-29 13:28:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665679   8 58451 48518029 A  ERROR'
2018-11-29 13:28:38 [DEBUG   ] Got command BAM from MCS: ref #665678
2018-11-29 13:28:38 [INFO    ] Finished processing BAM request
2018-11-29 13:28:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665678   8 58451 48518033 A  ERROR'
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:28:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:28:38 [DEBUG   ] spawn_process: at 2018-11-29 13:28:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:28:54 [DEBUG   ] Got command RPT from MCS: ref #665680
2018-11-29 13:28:54 [DEBUG   ] summary = ERROR
2018-11-29 13:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665680  13 58451 48534041 A  ERRORERROR'
2018-11-29 13:28:54 [DEBUG   ] Got command RPT from MCS: ref #665681
2018-11-29 13:28:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665681  77 58451 48534245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:28:54 [DEBUG   ] Got command RPT from MCS: ref #665682
2018-11-29 13:28:54 [DEBUG   ] summary = ERROR
2018-11-29 13:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665682  13 58451 48534437 A  ERRORERROR'
2018-11-29 13:28:54 [DEBUG   ] Got command RPT from MCS: ref #665683
2018-11-29 13:28:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665683  77 58451 48534641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:28:54 [DEBUG   ] Got command RPT from MCS: ref #665684
2018-11-29 13:28:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665684  12 58451 48534845 A  ERRORB¢ff'
2018-11-29 13:28:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 13:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:28:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:28:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:28:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:28:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:28:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:28:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:28:57 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-29 13:29:01 [DEBUG   ] Got command BAM from MCS: ref #665686
2018-11-29 13:29:01 [INFO    ] Finished processing BAM request
2018-11-29 13:29:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665686   8 58451 48541033 A  ERROR'
2018-11-29 13:29:01 [DEBUG   ] Got command BAM from MCS: ref #665685
2018-11-29 13:29:01 [INFO    ] Finished processing BAM request
2018-11-29 13:29:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665685   8 58451 48541037 A  ERROR'
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:29:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:29:01 [DEBUG   ] spawn_process: at 2018-11-29 13:29:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:29:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:29:24 [DEBUG   ] Got command BAM from MCS: ref #665692
2018-11-29 13:29:24 [INFO    ] Finished processing BAM request
2018-11-29 13:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665692   8 58451 48564033 A  ERROR'
2018-11-29 13:29:24 [DEBUG   ] Got command BAM from MCS: ref #665691
2018-11-29 13:29:24 [INFO    ] Finished processing BAM request
2018-11-29 13:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665691   8 58451 48564037 A  ERROR'
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:29:24 [DEBUG   ] spawn_process: at 2018-11-29 13:29:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:29:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 13:29:47 [DEBUG   ] Got command BAM from MCS: ref #665694
2018-11-29 13:29:47 [INFO    ] Finished processing BAM request
2018-11-29 13:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665694   8 58451 48587033 A  ERROR'
2018-11-29 13:29:47 [DEBUG   ] Got command BAM from MCS: ref #665693
2018-11-29 13:29:47 [INFO    ] Finished processing BAM request
2018-11-29 13:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665693   8 58451 48587037 A  ERROR'
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:29:47 [DEBUG   ] spawn_process: at 2018-11-29 13:29:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:29:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 13:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:29:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:29:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:29:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:29:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:29:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:29:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:29:57 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-29 13:30:10 [DEBUG   ] Got command BAM from MCS: ref #665695
2018-11-29 13:30:10 [INFO    ] Finished processing BAM request
2018-11-29 13:30:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665695   8 58451 48610025 A  ERROR'
2018-11-29 13:30:10 [DEBUG   ] Got command BAM from MCS: ref #665696
2018-11-29 13:30:10 [INFO    ] Finished processing BAM request
2018-11-29 13:30:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665696   8 58451 48610029 A  ERROR'
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:30:10 [DEBUG   ] spawn_process: at 2018-11-29 13:30:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:30:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 13:30:33 [DEBUG   ] Got command BAM from MCS: ref #665698
2018-11-29 13:30:33 [INFO    ] Finished processing BAM request
2018-11-29 13:30:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665698   8 58451 48633033 A  ERROR'
2018-11-29 13:30:33 [DEBUG   ] Got command BAM from MCS: ref #665697
2018-11-29 13:30:33 [INFO    ] Finished processing BAM request
2018-11-29 13:30:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665697   8 58451 48633037 A  ERROR'
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:30:33 [DEBUG   ] spawn_process: at 2018-11-29 13:30:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:30:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:30:49 [DEBUG   ] Got command RPT from MCS: ref #665699
2018-11-29 13:30:49 [DEBUG   ] summary = ERROR
2018-11-29 13:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665699  13 58451 48649689 A  ERRORERROR'
2018-11-29 13:30:49 [DEBUG   ] Got command RPT from MCS: ref #665700
2018-11-29 13:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665700  77 58451 48649690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:30:56 [DEBUG   ] Got command BAM from MCS: ref #665717
2018-11-29 13:30:56 [INFO    ] Finished processing BAM request
2018-11-29 13:30:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:30:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665717   8 58451 48656025 A  ERROR'
2018-11-29 13:30:56 [DEBUG   ] Got command BAM from MCS: ref #665716
2018-11-29 13:30:56 [INFO    ] Finished processing BAM request
2018-11-29 13:30:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:30:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665716   8 58451 48656029 A  ERROR'
2018-11-29 13:30:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:30:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:30:56 [DEBUG   ] spawn_process: at 2018-11-29 13:30:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:30:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 13:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:30:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:30:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:30:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:30:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:30:57 [WARNING ] (13, 1, 'bot')
2018-11-29 13:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:30:57 [DEBUG   ] Finished updating board flags in 0.972 seconds
2018-11-29 13:31:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:31:19 [DEBUG   ] Got command BAM from MCS: ref #665719
2018-11-29 13:31:19 [INFO    ] Finished processing BAM request
2018-11-29 13:31:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665719   8 58451 48679033 A  ERROR'
2018-11-29 13:31:19 [DEBUG   ] Got command BAM from MCS: ref #665718
2018-11-29 13:31:19 [INFO    ] Finished processing BAM request
2018-11-29 13:31:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:31:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665718   8 58451 48679037 A  ERROR'
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:31:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:31:19 [DEBUG   ] spawn_process: at 2018-11-29 13:31:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:31:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:31:42 [DEBUG   ] Got command BAM from MCS: ref #665721
2018-11-29 13:31:42 [INFO    ] Finished processing BAM request
2018-11-29 13:31:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665721   8 58451 48702030 A  ERROR'
2018-11-29 13:31:42 [DEBUG   ] Got command BAM from MCS: ref #665720
2018-11-29 13:31:42 [INFO    ] Finished processing BAM request
2018-11-29 13:31:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665720   8 58451 48702034 A  ERROR'
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:31:42 [DEBUG   ] spawn_process: at 2018-11-29 13:31:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:31:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 13:31:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 13:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 13:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 13:31:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:31:58 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-11-29 13:32:05 [DEBUG   ] Got command BAM from MCS: ref #665722
2018-11-29 13:32:05 [INFO    ] Finished processing BAM request
2018-11-29 13:32:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665722   8 58451 48725030 A  ERROR'
2018-11-29 13:32:05 [DEBUG   ] Got command BAM from MCS: ref #665723
2018-11-29 13:32:05 [INFO    ] Finished processing BAM request
2018-11-29 13:32:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665723   8 58451 48725034 A  ERROR'
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:32:05 [DEBUG   ] spawn_process: at 2018-11-29 13:32:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:32:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:32:28 [DEBUG   ] Got command BAM from MCS: ref #665728
2018-11-29 13:32:28 [INFO    ] Finished processing BAM request
2018-11-29 13:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665728   8 58451 48748030 A  ERROR'
2018-11-29 13:32:28 [DEBUG   ] Got command BAM from MCS: ref #665729
2018-11-29 13:32:28 [INFO    ] Finished processing BAM request
2018-11-29 13:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665729   8 58451 48748034 A  ERROR'
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:32:28 [DEBUG   ] spawn_process: at 2018-11-29 13:32:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:32:51 [DEBUG   ] Got command BAM from MCS: ref #665731
2018-11-29 13:32:51 [INFO    ] Finished processing BAM request
2018-11-29 13:32:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:32:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665731   8 58451 48771030 A  ERROR'
2018-11-29 13:32:51 [DEBUG   ] Got command BAM from MCS: ref #665730
2018-11-29 13:32:51 [INFO    ] Finished processing BAM request
2018-11-29 13:32:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:32:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665730   8 58451 48771034 A  ERROR'
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:32:51 [DEBUG   ] spawn_process: at 2018-11-29 13:32:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:32:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:32:58 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-29 13:33:14 [DEBUG   ] Got command BAM from MCS: ref #665733
2018-11-29 13:33:14 [INFO    ] Finished processing BAM request
2018-11-29 13:33:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665733   8 58451 48794030 A  ERROR'
2018-11-29 13:33:14 [DEBUG   ] Got command BAM from MCS: ref #665732
2018-11-29 13:33:14 [INFO    ] Finished processing BAM request
2018-11-29 13:33:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665732   8 58451 48794034 A  ERROR'
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:33:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:33:14 [DEBUG   ] spawn_process: at 2018-11-29 13:33:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:33:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:33:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:33:37 [DEBUG   ] Got command BAM from MCS: ref #665737
2018-11-29 13:33:37 [INFO    ] Finished processing BAM request
2018-11-29 13:33:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665737   8 58451 48817025 A  ERROR'
2018-11-29 13:33:37 [DEBUG   ] Got command BAM from MCS: ref #665736
2018-11-29 13:33:37 [INFO    ] Finished processing BAM request
2018-11-29 13:33:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665736   8 58451 48817029 A  ERROR'
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:33:37 [DEBUG   ] spawn_process: at 2018-11-29 13:33:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:33:54 [DEBUG   ] Got command RPT from MCS: ref #665738
2018-11-29 13:33:54 [DEBUG   ] summary = ERROR
2018-11-29 13:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665738  13 58451 48834121 A  ERRORERROR'
2018-11-29 13:33:54 [DEBUG   ] Got command RPT from MCS: ref #665739
2018-11-29 13:33:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665739  77 58451 48834325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:33:54 [DEBUG   ] Got command RPT from MCS: ref #665740
2018-11-29 13:33:54 [DEBUG   ] summary = ERROR
2018-11-29 13:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665740  13 58451 48834529 A  ERRORERROR'
2018-11-29 13:33:54 [DEBUG   ] Got command RPT from MCS: ref #665742
2018-11-29 13:33:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665742  77 58451 48834721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:33:54 [DEBUG   ] Got command RPT from MCS: ref #665744
2018-11-29 13:33:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665744  12 58451 48834925 A  ERRORB£ff'
2018-11-29 13:33:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 13:33:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:33:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:33:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:33:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:33:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:33:58 [DEBUG   ] Finished updating board flags in 1.315 seconds
2018-11-29 13:34:00 [DEBUG   ] Got command BAM from MCS: ref #665748
2018-11-29 13:34:00 [INFO    ] Finished processing BAM request
2018-11-29 13:34:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665748   8 58451 48840025 A  ERROR'
2018-11-29 13:34:00 [DEBUG   ] Got command BAM from MCS: ref #665749
2018-11-29 13:34:00 [INFO    ] Finished processing BAM request
2018-11-29 13:34:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665749   8 58451 48840029 A  ERROR'
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:34:00 [DEBUG   ] spawn_process: at 2018-11-29 13:34:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:34:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:34:23 [DEBUG   ] Got command BAM from MCS: ref #665751
2018-11-29 13:34:23 [INFO    ] Finished processing BAM request
2018-11-29 13:34:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665751   8 58451 48863029 A  ERROR'
2018-11-29 13:34:23 [DEBUG   ] Got command BAM from MCS: ref #665750
2018-11-29 13:34:23 [INFO    ] Finished processing BAM request
2018-11-29 13:34:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665750   8 58451 48863033 A  ERROR'
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:34:23 [DEBUG   ] spawn_process: at 2018-11-29 13:34:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:34:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:34:46 [DEBUG   ] Got command BAM from MCS: ref #665753
2018-11-29 13:34:46 [INFO    ] Finished processing BAM request
2018-11-29 13:34:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665753   8 58451 48886033 A  ERROR'
2018-11-29 13:34:46 [DEBUG   ] Got command BAM from MCS: ref #665752
2018-11-29 13:34:46 [INFO    ] Finished processing BAM request
2018-11-29 13:34:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665752   8 58451 48886037 A  ERROR'
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:34:46 [DEBUG   ] spawn_process: at 2018-11-29 13:34:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:34:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 13:34:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:34:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:34:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:34:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:34:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:34:58 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-29 13:35:09 [DEBUG   ] Got command BAM from MCS: ref #665759
2018-11-29 13:35:09 [INFO    ] Finished processing BAM request
2018-11-29 13:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665759   8 58451 48909029 A  ERROR'
2018-11-29 13:35:09 [DEBUG   ] Got command BAM from MCS: ref #665758
2018-11-29 13:35:09 [INFO    ] Finished processing BAM request
2018-11-29 13:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665758   8 58451 48909033 A  ERROR'
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:35:09 [DEBUG   ] spawn_process: at 2018-11-29 13:35:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:35:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 13:35:32 [DEBUG   ] Got command BAM from MCS: ref #665760
2018-11-29 13:35:32 [INFO    ] Finished processing BAM request
2018-11-29 13:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665760   8 58451 48932029 A  ERROR'
2018-11-29 13:35:32 [DEBUG   ] Got command BAM from MCS: ref #665761
2018-11-29 13:35:32 [INFO    ] Finished processing BAM request
2018-11-29 13:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665761   8 58451 48932033 A  ERROR'
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:35:32 [DEBUG   ] spawn_process: at 2018-11-29 13:35:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:35:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 13:35:49 [DEBUG   ] Got command RPT from MCS: ref #665762
2018-11-29 13:35:49 [DEBUG   ] summary = ERROR
2018-11-29 13:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665762  13 58451 48949689 A  ERRORERROR'
2018-11-29 13:35:49 [DEBUG   ] Got command RPT from MCS: ref #665763
2018-11-29 13:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665763  77 58451 48949690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:35:55 [DEBUG   ] Got command BAM from MCS: ref #665779
2018-11-29 13:35:55 [INFO    ] Finished processing BAM request
2018-11-29 13:35:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665779   8 58451 48955025 A  ERROR'
2018-11-29 13:35:55 [DEBUG   ] Got command BAM from MCS: ref #665780
2018-11-29 13:35:55 [INFO    ] Finished processing BAM request
2018-11-29 13:35:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665780   8 58451 48955029 A  ERROR'
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:35:55 [DEBUG   ] spawn_process: at 2018-11-29 13:35:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:35:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 13:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 13:35:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:35:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:35:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:35:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:35:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:35:58 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-29 13:36:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:36:18 [DEBUG   ] Got command BAM from MCS: ref #665782
2018-11-29 13:36:18 [INFO    ] Finished processing BAM request
2018-11-29 13:36:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665782   8 58451 48978033 A  ERROR'
2018-11-29 13:36:18 [DEBUG   ] Got command BAM from MCS: ref #665781
2018-11-29 13:36:18 [INFO    ] Finished processing BAM request
2018-11-29 13:36:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665781   8 58451 48978037 A  ERROR'
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:36:18 [DEBUG   ] spawn_process: at 2018-11-29 13:36:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:36:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:36:41 [DEBUG   ] Got command BAM from MCS: ref #665783
2018-11-29 13:36:41 [INFO    ] Finished processing BAM request
2018-11-29 13:36:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665783   8 58451 49001025 A  ERROR'
2018-11-29 13:36:41 [DEBUG   ] Got command BAM from MCS: ref #665784
2018-11-29 13:36:41 [INFO    ] Finished processing BAM request
2018-11-29 13:36:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665784   8 58451 49001029 A  ERROR'
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:36:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:36:41 [DEBUG   ] spawn_process: at 2018-11-29 13:36:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:36:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:36:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 13:36:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:36:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:36:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:36:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:36:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:36:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:36:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:36:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-29 13:37:03 [DEBUG   ] Got command BAM from MCS: ref #665785
2018-11-29 13:37:03 [INFO    ] Finished processing BAM request
2018-11-29 13:37:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:37:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665785   8 58451 49023025 A  ERROR'
2018-11-29 13:37:03 [DEBUG   ] Got command BAM from MCS: ref #665786
2018-11-29 13:37:03 [INFO    ] Finished processing BAM request
2018-11-29 13:37:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:37:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665786   8 58451 49023029 A  ERROR'
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:37:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:37:03 [DEBUG   ] spawn_process: at 2018-11-29 13:37:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:37:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:37:25 [DEBUG   ] Got command BAM from MCS: ref #665787
2018-11-29 13:37:25 [INFO    ] Finished processing BAM request
2018-11-29 13:37:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665787   8 58451 49045029 A  ERROR'
2018-11-29 13:37:25 [DEBUG   ] Got command BAM from MCS: ref #665788
2018-11-29 13:37:25 [INFO    ] Finished processing BAM request
2018-11-29 13:37:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665788   8 58451 49045033 A  ERROR'
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:37:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:37:25 [DEBUG   ] spawn_process: at 2018-11-29 13:37:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:37:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:37:47 [DEBUG   ] Got command BAM from MCS: ref #665789
2018-11-29 13:37:47 [INFO    ] Finished processing BAM request
2018-11-29 13:37:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:37:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665789   8 58451 49067033 A  ERROR'
2018-11-29 13:37:47 [DEBUG   ] Got command BAM from MCS: ref #665790
2018-11-29 13:37:47 [INFO    ] Finished processing BAM request
2018-11-29 13:37:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:37:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665790   8 58451 49067037 A  ERROR'
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:37:47 [DEBUG   ] spawn_process: at 2018-11-29 13:37:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:37:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 13:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 13:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 13:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:37:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:37:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:37:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:37:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:37:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:37:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:37:58 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-11-29 13:38:09 [DEBUG   ] Got command BAM from MCS: ref #665796
2018-11-29 13:38:09 [INFO    ] Finished processing BAM request
2018-11-29 13:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665796   8 58451 49089033 A  ERROR'
2018-11-29 13:38:09 [DEBUG   ] Got command BAM from MCS: ref #665795
2018-11-29 13:38:09 [INFO    ] Finished processing BAM request
2018-11-29 13:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665795   8 58451 49089037 A  ERROR'
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:38:09 [DEBUG   ] spawn_process: at 2018-11-29 13:38:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:38:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:38:31 [DEBUG   ] Got command BAM from MCS: ref #665797
2018-11-29 13:38:31 [INFO    ] Finished processing BAM request
2018-11-29 13:38:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665797   8 58451 49111029 A  ERROR'
2018-11-29 13:38:31 [DEBUG   ] Got command BAM from MCS: ref #665798
2018-11-29 13:38:31 [INFO    ] Finished processing BAM request
2018-11-29 13:38:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665798   8 58451 49111037 A  ERROR'
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:38:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:38:31 [DEBUG   ] spawn_process: at 2018-11-29 13:38:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:38:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:38:53 [DEBUG   ] Got command BAM from MCS: ref #665799
2018-11-29 13:38:53 [INFO    ] Finished processing BAM request
2018-11-29 13:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665799   8 58451 49133025 A  ERROR'
2018-11-29 13:38:53 [DEBUG   ] Got command BAM from MCS: ref #665800
2018-11-29 13:38:53 [INFO    ] Finished processing BAM request
2018-11-29 13:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665800   8 58451 49133029 A  ERROR'
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:38:53 [DEBUG   ] spawn_process: at 2018-11-29 13:38:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:38:54 [DEBUG   ] Got command RPT from MCS: ref #665801
2018-11-29 13:38:54 [DEBUG   ] summary = ERROR
2018-11-29 13:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665801  13 58451 49134209 A  ERRORERROR'
2018-11-29 13:38:54 [DEBUG   ] Got command RPT from MCS: ref #665802
2018-11-29 13:38:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665802  77 58451 49134413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:38:54 [DEBUG   ] Got command RPT from MCS: ref #665803
2018-11-29 13:38:54 [DEBUG   ] summary = ERROR
2018-11-29 13:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665803  13 58451 49134617 A  ERRORERROR'
2018-11-29 13:38:54 [DEBUG   ] Got command RPT from MCS: ref #665804
2018-11-29 13:38:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:38:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665804  77 58451 49134809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:38:55 [DEBUG   ] Got command RPT from MCS: ref #665805
2018-11-29 13:38:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665805  12 58451 49135013 A  ERRORB¤ff'
2018-11-29 13:38:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 13:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:38:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:38:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:38:59 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-29 13:39:15 [DEBUG   ] Got command BAM from MCS: ref #665807
2018-11-29 13:39:15 [INFO    ] Finished processing BAM request
2018-11-29 13:39:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665807   8 58451 49155033 A  ERROR'
2018-11-29 13:39:15 [DEBUG   ] Got command BAM from MCS: ref #665806
2018-11-29 13:39:15 [INFO    ] Finished processing BAM request
2018-11-29 13:39:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665806   8 58451 49155037 A  ERROR'
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:39:15 [DEBUG   ] spawn_process: at 2018-11-29 13:39:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:39:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 13:39:36 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 13:39:37 [DEBUG   ] Got command BAM from MCS: ref #665809
2018-11-29 13:39:37 [INFO    ] Finished processing BAM request
2018-11-29 13:39:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665809   8 58451 49177025 A  ERROR'
2018-11-29 13:39:37 [DEBUG   ] Got command BAM from MCS: ref #665808
2018-11-29 13:39:37 [INFO    ] Finished processing BAM request
2018-11-29 13:39:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665808   8 58451 49177029 A  ERROR'
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:39:37 [DEBUG   ] spawn_process: at 2018-11-29 13:39:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:39:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 13:39:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:39:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:39:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:39:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:39:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:39:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:39:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:39:58 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-11-29 13:39:59 [DEBUG   ] Got command BAM from MCS: ref #665810
2018-11-29 13:39:59 [INFO    ] Finished processing BAM request
2018-11-29 13:39:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665810   8 58451 49199029 A  ERROR'
2018-11-29 13:39:59 [DEBUG   ] Got command BAM from MCS: ref #665811
2018-11-29 13:39:59 [INFO    ] Finished processing BAM request
2018-11-29 13:39:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665811   8 58451 49199033 A  ERROR'
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:39:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:39:59 [DEBUG   ] spawn_process: at 2018-11-29 13:39:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:40:21 [DEBUG   ] Got command BAM from MCS: ref #665812
2018-11-29 13:40:21 [INFO    ] Finished processing BAM request
2018-11-29 13:40:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665812   8 58451 49221029 A  ERROR'
2018-11-29 13:40:21 [DEBUG   ] Got command BAM from MCS: ref #665813
2018-11-29 13:40:21 [INFO    ] Finished processing BAM request
2018-11-29 13:40:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665813   8 58451 49221033 A  ERROR'
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:40:21 [DEBUG   ] spawn_process: at 2018-11-29 13:40:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:40:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:40:43 [DEBUG   ] Got command BAM from MCS: ref #665815
2018-11-29 13:40:43 [INFO    ] Finished processing BAM request
2018-11-29 13:40:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:40:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665815   8 58451 49243029 A  ERROR'
2018-11-29 13:40:43 [DEBUG   ] Got command BAM from MCS: ref #665814
2018-11-29 13:40:43 [INFO    ] Finished processing BAM request
2018-11-29 13:40:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:40:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665814   8 58451 49243033 A  ERROR'
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:40:43 [DEBUG   ] spawn_process: at 2018-11-29 13:40:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:40:49 [DEBUG   ] Got command RPT from MCS: ref #665816
2018-11-29 13:40:49 [DEBUG   ] summary = ERROR
2018-11-29 13:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665816  13 58451 49249693 A  ERRORERROR'
2018-11-29 13:40:49 [DEBUG   ] Got command RPT from MCS: ref #665817
2018-11-29 13:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665817  77 58451 49249694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:40:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-29 13:40:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:40:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:40:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:40:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:40:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:40:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:40:58 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-29 13:41:05 [DEBUG   ] Got command BAM from MCS: ref #665833
2018-11-29 13:41:05 [INFO    ] Finished processing BAM request
2018-11-29 13:41:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665833   8 58451 49265033 A  ERROR'
2018-11-29 13:41:05 [DEBUG   ] Got command BAM from MCS: ref #665834
2018-11-29 13:41:05 [INFO    ] Finished processing BAM request
2018-11-29 13:41:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665834   8 58451 49265037 A  ERROR'
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:41:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:41:05 [DEBUG   ] spawn_process: at 2018-11-29 13:41:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:41:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:41:27 [DEBUG   ] Got command BAM from MCS: ref #665839
2018-11-29 13:41:27 [INFO    ] Finished processing BAM request
2018-11-29 13:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665839   8 58451 49287033 A  ERROR'
2018-11-29 13:41:27 [DEBUG   ] Got command BAM from MCS: ref #665840
2018-11-29 13:41:27 [INFO    ] Finished processing BAM request
2018-11-29 13:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665840   8 58451 49287037 A  ERROR'
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:41:27 [DEBUG   ] spawn_process: at 2018-11-29 13:41:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:41:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:41:49 [DEBUG   ] Got command BAM from MCS: ref #665842
2018-11-29 13:41:49 [INFO    ] Finished processing BAM request
2018-11-29 13:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665842   8 58451 49309029 A  ERROR'
2018-11-29 13:41:49 [DEBUG   ] Got command BAM from MCS: ref #665841
2018-11-29 13:41:49 [INFO    ] Finished processing BAM request
2018-11-29 13:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665841   8 58451 49309033 A  ERROR'
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:41:49 [DEBUG   ] spawn_process: at 2018-11-29 13:41:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-11-29 13:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:41:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:41:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:41:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:41:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:41:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:41:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:41:58 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-29 13:42:11 [DEBUG   ] Got command BAM from MCS: ref #665844
2018-11-29 13:42:11 [INFO    ] Finished processing BAM request
2018-11-29 13:42:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665844   8 58451 49331029 A  ERROR'
2018-11-29 13:42:11 [DEBUG   ] Got command BAM from MCS: ref #665843
2018-11-29 13:42:11 [INFO    ] Finished processing BAM request
2018-11-29 13:42:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665843   8 58451 49331033 A  ERROR'
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:42:11 [DEBUG   ] spawn_process: at 2018-11-29 13:42:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:42:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:42:33 [DEBUG   ] Got command BAM from MCS: ref #665846
2018-11-29 13:42:33 [INFO    ] Finished processing BAM request
2018-11-29 13:42:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665846   8 58451 49353025 A  ERROR'
2018-11-29 13:42:33 [DEBUG   ] Got command BAM from MCS: ref #665845
2018-11-29 13:42:33 [INFO    ] Finished processing BAM request
2018-11-29 13:42:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665845   8 58451 49353029 A  ERROR'
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:42:33 [DEBUG   ] spawn_process: at 2018-11-29 13:42:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:42:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:42:55 [DEBUG   ] Got command BAM from MCS: ref #665847
2018-11-29 13:42:55 [INFO    ] Finished processing BAM request
2018-11-29 13:42:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665847   8 58451 49375025 A  ERROR'
2018-11-29 13:42:55 [DEBUG   ] Got command BAM from MCS: ref #665848
2018-11-29 13:42:55 [INFO    ] Finished processing BAM request
2018-11-29 13:42:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665848   8 58451 49375029 A  ERROR'
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:42:55 [DEBUG   ] spawn_process: at 2018-11-29 13:42:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:42:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:42:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:42:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:42:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:42:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:42:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:42:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:42:58 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-29 13:43:17 [DEBUG   ] Got command BAM from MCS: ref #665849
2018-11-29 13:43:17 [INFO    ] Finished processing BAM request
2018-11-29 13:43:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665849   8 58451 49397033 A  ERROR'
2018-11-29 13:43:17 [DEBUG   ] Got command BAM from MCS: ref #665850
2018-11-29 13:43:17 [INFO    ] Finished processing BAM request
2018-11-29 13:43:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665850   8 58451 49397037 A  ERROR'
2018-11-29 13:43:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:43:17 [DEBUG   ] spawn_process: at 2018-11-29 13:43:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:43:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:43:39 [DEBUG   ] Got command BAM from MCS: ref #665854
2018-11-29 13:43:39 [INFO    ] Finished processing BAM request
2018-11-29 13:43:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665854   8 58451 49419033 A  ERROR'
2018-11-29 13:43:39 [DEBUG   ] Got command BAM from MCS: ref #665853
2018-11-29 13:43:39 [INFO    ] Finished processing BAM request
2018-11-29 13:43:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665853   8 58451 49419037 A  ERROR'
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:43:39 [DEBUG   ] spawn_process: at 2018-11-29 13:43:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:43:54 [DEBUG   ] Got command RPT from MCS: ref #665855
2018-11-29 13:43:54 [DEBUG   ] summary = ERROR
2018-11-29 13:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665855  13 58451 49434297 A  ERRORERROR'
2018-11-29 13:43:54 [DEBUG   ] Got command RPT from MCS: ref #665856
2018-11-29 13:43:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665856  77 58451 49434501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:43:54 [DEBUG   ] Got command RPT from MCS: ref #665857
2018-11-29 13:43:54 [DEBUG   ] summary = ERROR
2018-11-29 13:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665857  13 58451 49434693 A  ERRORERROR'
2018-11-29 13:43:54 [DEBUG   ] Got command RPT from MCS: ref #665859
2018-11-29 13:43:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665859  77 58451 49434897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:43:55 [DEBUG   ] Got command RPT from MCS: ref #665861
2018-11-29 13:43:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665861  12 58451 49435101 A  ERRORB¤ff'
2018-11-29 13:43:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 13:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:43:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:43:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:43:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:43:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:43:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:43:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:43:58 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-29 13:44:01 [DEBUG   ] Got command BAM from MCS: ref #665865
2018-11-29 13:44:01 [INFO    ] Finished processing BAM request
2018-11-29 13:44:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665865   8 58451 49441033 A  ERROR'
2018-11-29 13:44:01 [DEBUG   ] Got command BAM from MCS: ref #665866
2018-11-29 13:44:01 [INFO    ] Finished processing BAM request
2018-11-29 13:44:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665866   8 58451 49441037 A  ERROR'
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:44:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:44:01 [DEBUG   ] spawn_process: at 2018-11-29 13:44:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:44:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:44:23 [DEBUG   ] Got command BAM from MCS: ref #665871
2018-11-29 13:44:23 [INFO    ] Finished processing BAM request
2018-11-29 13:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665871   8 58451 49463029 A  ERROR'
2018-11-29 13:44:23 [DEBUG   ] Got command BAM from MCS: ref #665872
2018-11-29 13:44:23 [INFO    ] Finished processing BAM request
2018-11-29 13:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665872   8 58451 49463033 A  ERROR'
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:44:23 [DEBUG   ] spawn_process: at 2018-11-29 13:44:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:44:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:44:45 [DEBUG   ] Got command BAM from MCS: ref #665873
2018-11-29 13:44:45 [INFO    ] Finished processing BAM request
2018-11-29 13:44:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665873   8 58451 49485029 A  ERROR'
2018-11-29 13:44:45 [DEBUG   ] Got command BAM from MCS: ref #665874
2018-11-29 13:44:45 [INFO    ] Finished processing BAM request
2018-11-29 13:44:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665874   8 58451 49485033 A  ERROR'
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:44:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:44:45 [DEBUG   ] spawn_process: at 2018-11-29 13:44:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:44:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 13:44:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:44:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:44:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:44:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:44:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:44:58 [DEBUG   ] Finished updating board flags in 1.062 seconds
2018-11-29 13:45:07 [DEBUG   ] Got command BAM from MCS: ref #665875
2018-11-29 13:45:07 [INFO    ] Finished processing BAM request
2018-11-29 13:45:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665875   8 58451 49507029 A  ERROR'
2018-11-29 13:45:07 [DEBUG   ] Got command BAM from MCS: ref #665876
2018-11-29 13:45:07 [INFO    ] Finished processing BAM request
2018-11-29 13:45:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665876   8 58451 49507033 A  ERROR'
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:45:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:45:07 [DEBUG   ] spawn_process: at 2018-11-29 13:45:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:45:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:45:29 [DEBUG   ] Got command BAM from MCS: ref #665878
2018-11-29 13:45:29 [INFO    ] Finished processing BAM request
2018-11-29 13:45:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665878   8 58451 49529033 A  ERROR'
2018-11-29 13:45:29 [DEBUG   ] Got command BAM from MCS: ref #665877
2018-11-29 13:45:29 [INFO    ] Finished processing BAM request
2018-11-29 13:45:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665877   8 58451 49529037 A  ERROR'
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:45:29 [DEBUG   ] spawn_process: at 2018-11-29 13:45:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:45:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:45:49 [DEBUG   ] Got command RPT from MCS: ref #665879
2018-11-29 13:45:49 [DEBUG   ] summary = ERROR
2018-11-29 13:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665879  13 58451 49549689 A  ERRORERROR'
2018-11-29 13:45:49 [DEBUG   ] Got command RPT from MCS: ref #665880
2018-11-29 13:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665880  77 58451 49549690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:45:51 [DEBUG   ] Got command BAM from MCS: ref #665897
2018-11-29 13:45:51 [INFO    ] Finished processing BAM request
2018-11-29 13:45:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:45:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665897   8 58451 49551033 A  ERROR'
2018-11-29 13:45:51 [DEBUG   ] Got command BAM from MCS: ref #665896
2018-11-29 13:45:51 [INFO    ] Finished processing BAM request
2018-11-29 13:45:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:45:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665896   8 58451 49551037 A  ERROR'
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:45:51 [DEBUG   ] spawn_process: at 2018-11-29 13:45:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:45:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:45:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:45:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:45:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:45:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:45:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:45:58 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-29 13:46:13 [DEBUG   ] Got command BAM from MCS: ref #665899
2018-11-29 13:46:13 [INFO    ] Finished processing BAM request
2018-11-29 13:46:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665899   8 58451 49573029 A  ERROR'
2018-11-29 13:46:13 [DEBUG   ] Got command BAM from MCS: ref #665898
2018-11-29 13:46:13 [INFO    ] Finished processing BAM request
2018-11-29 13:46:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:46:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665898   8 58451 49573033 A  ERROR'
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:46:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:46:13 [DEBUG   ] spawn_process: at 2018-11-29 13:46:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:46:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:46:35 [DEBUG   ] Got command BAM from MCS: ref #665901
2018-11-29 13:46:35 [INFO    ] Finished processing BAM request
2018-11-29 13:46:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665901   8 58451 49595033 A  ERROR'
2018-11-29 13:46:35 [DEBUG   ] Got command BAM from MCS: ref #665900
2018-11-29 13:46:35 [INFO    ] Finished processing BAM request
2018-11-29 13:46:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665900   8 58451 49595037 A  ERROR'
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:46:35 [DEBUG   ] spawn_process: at 2018-11-29 13:46:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:46:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:46:57 [DEBUG   ] Got command BAM from MCS: ref #665903
2018-11-29 13:46:57 [INFO    ] Finished processing BAM request
2018-11-29 13:46:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665903   8 58451 49617033 A  ERROR'
2018-11-29 13:46:57 [DEBUG   ] Got command BAM from MCS: ref #665902
2018-11-29 13:46:57 [INFO    ] Finished processing BAM request
2018-11-29 13:46:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665902   8 58451 49617037 A  ERROR'
2018-11-29 13:46:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:46:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:46:57 [DEBUG   ] spawn_process: at 2018-11-29 13:46:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 13:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:46:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:46:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:46:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:46:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:46:58 [WARNING ] (13, 1, 'bot')
2018-11-29 13:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:46:58 [DEBUG   ] Finished updating board flags in 0.890 seconds
2018-11-29 13:47:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 13:47:19 [DEBUG   ] Got command BAM from MCS: ref #665909
2018-11-29 13:47:19 [INFO    ] Finished processing BAM request
2018-11-29 13:47:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665909   8 58451 49639033 A  ERROR'
2018-11-29 13:47:19 [DEBUG   ] Got command BAM from MCS: ref #665908
2018-11-29 13:47:19 [INFO    ] Finished processing BAM request
2018-11-29 13:47:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665908   8 58451 49639037 A  ERROR'
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:47:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:47:19 [DEBUG   ] spawn_process: at 2018-11-29 13:47:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:47:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:47:41 [DEBUG   ] Got command BAM from MCS: ref #665910
2018-11-29 13:47:41 [INFO    ] Finished processing BAM request
2018-11-29 13:47:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665910   8 58451 49661033 A  ERROR'
2018-11-29 13:47:41 [DEBUG   ] Got command BAM from MCS: ref #665911
2018-11-29 13:47:41 [INFO    ] Finished processing BAM request
2018-11-29 13:47:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665911   8 58451 49661037 A  ERROR'
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:47:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:47:41 [DEBUG   ] spawn_process: at 2018-11-29 13:47:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:47:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 13:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:47:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:47:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:47:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:47:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:47:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:47:59 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-29 13:48:03 [DEBUG   ] Got command BAM from MCS: ref #665912
2018-11-29 13:48:03 [INFO    ] Finished processing BAM request
2018-11-29 13:48:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665912   8 58451 49683026 A  ERROR'
2018-11-29 13:48:03 [DEBUG   ] Got command BAM from MCS: ref #665913
2018-11-29 13:48:03 [INFO    ] Finished processing BAM request
2018-11-29 13:48:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665913   8 58451 49683030 A  ERROR'
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:48:03 [DEBUG   ] spawn_process: at 2018-11-29 13:48:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:48:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 13:48:25 [DEBUG   ] Got command BAM from MCS: ref #665914
2018-11-29 13:48:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665914   8 58451 49705030 A  ERROR'
2018-11-29 13:48:25 [DEBUG   ] Got command BAM from MCS: ref #665915
2018-11-29 13:48:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665915   8 58451 49705034 A  ERROR'
2018-11-29 13:48:25 [INFO    ] Finished processing BAM request
2018-11-29 13:48:25 [INFO    ] Finished processing BAM request
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:48:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:48:25 [DEBUG   ] spawn_process: at 2018-11-29 13:48:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:48:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 13:48:47 [DEBUG   ] Got command BAM from MCS: ref #665916
2018-11-29 13:48:47 [INFO    ] Finished processing BAM request
2018-11-29 13:48:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665916   8 58451 49727030 A  ERROR'
2018-11-29 13:48:47 [DEBUG   ] Got command BAM from MCS: ref #665917
2018-11-29 13:48:47 [INFO    ] Finished processing BAM request
2018-11-29 13:48:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665917   8 58451 49727034 A  ERROR'
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:48:47 [DEBUG   ] spawn_process: at 2018-11-29 13:48:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:48:54 [DEBUG   ] Got command RPT from MCS: ref #665918
2018-11-29 13:48:54 [DEBUG   ] summary = ERROR
2018-11-29 13:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665918  13 58451 49734378 A  ERRORERROR'
2018-11-29 13:48:54 [DEBUG   ] Got command RPT from MCS: ref #665919
2018-11-29 13:48:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665919  77 58451 49734581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:48:54 [DEBUG   ] Got command RPT from MCS: ref #665920
2018-11-29 13:48:54 [DEBUG   ] summary = ERROR
2018-11-29 13:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665920  13 58451 49734786 A  ERRORERROR'
2018-11-29 13:48:54 [DEBUG   ] Got command RPT from MCS: ref #665921
2018-11-29 13:48:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665921  77 58451 49734989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:48:55 [DEBUG   ] Got command RPT from MCS: ref #665922
2018-11-29 13:48:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665922  12 58451 49735182 A  ERRORB¢ff'
2018-11-29 13:48:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 13:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:48:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:48:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:48:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:48:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:48:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:48:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:48:59 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-29 13:49:09 [DEBUG   ] Got command BAM from MCS: ref #665924
2018-11-29 13:49:09 [INFO    ] Finished processing BAM request
2018-11-29 13:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665924   8 58451 49749029 A  ERROR'
2018-11-29 13:49:09 [DEBUG   ] Got command BAM from MCS: ref #665923
2018-11-29 13:49:09 [INFO    ] Finished processing BAM request
2018-11-29 13:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665923   8 58451 49749033 A  ERROR'
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:49:09 [DEBUG   ] spawn_process: at 2018-11-29 13:49:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:49:17 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-29 13:49:31 [DEBUG   ] Got command BAM from MCS: ref #665926
2018-11-29 13:49:31 [INFO    ] Finished processing BAM request
2018-11-29 13:49:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665926   8 58451 49771033 A  ERROR'
2018-11-29 13:49:31 [DEBUG   ] Got command BAM from MCS: ref #665925
2018-11-29 13:49:31 [INFO    ] Finished processing BAM request
2018-11-29 13:49:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665925   8 58451 49771037 A  ERROR'
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:49:31 [DEBUG   ] spawn_process: at 2018-11-29 13:49:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:49:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:49:53 [DEBUG   ] Got command BAM from MCS: ref #665928
2018-11-29 13:49:53 [INFO    ] Finished processing BAM request
2018-11-29 13:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665928   8 58451 49793025 A  ERROR'
2018-11-29 13:49:53 [DEBUG   ] Got command BAM from MCS: ref #665927
2018-11-29 13:49:53 [INFO    ] Finished processing BAM request
2018-11-29 13:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665927   8 58451 49793029 A  ERROR'
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:49:53 [DEBUG   ] spawn_process: at 2018-11-29 13:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:49:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 13:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:49:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:49:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:49:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:49:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:49:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:49:59 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-29 13:50:15 [DEBUG   ] Got command BAM from MCS: ref #665934
2018-11-29 13:50:15 [INFO    ] Finished processing BAM request
2018-11-29 13:50:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665934   8 58451 49815033 A  ERROR'
2018-11-29 13:50:15 [DEBUG   ] Got command BAM from MCS: ref #665933
2018-11-29 13:50:15 [INFO    ] Finished processing BAM request
2018-11-29 13:50:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665933   8 58451 49815037 A  ERROR'
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:50:15 [DEBUG   ] spawn_process: at 2018-11-29 13:50:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:50:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:50:37 [DEBUG   ] Got command BAM from MCS: ref #665936
2018-11-29 13:50:37 [INFO    ] Finished processing BAM request
2018-11-29 13:50:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665936   8 58451 49837033 A  ERROR'
2018-11-29 13:50:37 [DEBUG   ] Got command BAM from MCS: ref #665935
2018-11-29 13:50:37 [INFO    ] Finished processing BAM request
2018-11-29 13:50:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665935   8 58451 49837041 A  ERROR'
2018-11-29 13:50:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:50:37 [DEBUG   ] spawn_process: at 2018-11-29 13:50:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:50:49 [DEBUG   ] Got command RPT from MCS: ref #665937
2018-11-29 13:50:49 [DEBUG   ] summary = ERROR
2018-11-29 13:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665937  13 58451 49849701 A  ERRORERROR'
2018-11-29 13:50:49 [DEBUG   ] Got command RPT from MCS: ref #665938
2018-11-29 13:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665938  77 58451 49849702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:50:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:50:59 [DEBUG   ] Got command BAM from MCS: ref #665954
2018-11-29 13:50:59 [INFO    ] Finished processing BAM request
2018-11-29 13:50:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665954   8 58451 49859029 A  ERROR'
2018-11-29 13:50:59 [DEBUG   ] Got command BAM from MCS: ref #665955
2018-11-29 13:50:59 [INFO    ] Finished processing BAM request
2018-11-29 13:50:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:50:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665955   8 58451 49859033 A  ERROR'
2018-11-29 13:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 13:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:50:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 13:50:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:50:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:50:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:50:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:50:59 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:50:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:50:59 [DEBUG   ] spawn_process: at 2018-11-29 13:50:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:51:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:51:21 [DEBUG   ] Got command BAM from MCS: ref #665957
2018-11-29 13:51:21 [INFO    ] Finished processing BAM request
2018-11-29 13:51:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665957   8 58451 49881025 A  ERROR'
2018-11-29 13:51:21 [DEBUG   ] Got command BAM from MCS: ref #665956
2018-11-29 13:51:21 [INFO    ] Finished processing BAM request
2018-11-29 13:51:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665956   8 58451 49881029 A  ERROR'
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:51:21 [DEBUG   ] spawn_process: at 2018-11-29 13:51:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:51:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:51:43 [DEBUG   ] Got command BAM from MCS: ref #665958
2018-11-29 13:51:43 [INFO    ] Finished processing BAM request
2018-11-29 13:51:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665958   8 58451 49903037 A  ERROR'
2018-11-29 13:51:43 [DEBUG   ] Got command BAM from MCS: ref #665959
2018-11-29 13:51:43 [INFO    ] Finished processing BAM request
2018-11-29 13:51:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665959   8 58451 49903045 A  ERROR'
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:51:43 [DEBUG   ] spawn_process: at 2018-11-29 13:51:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:51:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-11-29 13:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 13:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 13:51:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:51:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 13:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 13:51:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:51:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:51:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:51:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:51:59 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-29 13:52:05 [DEBUG   ] Got command BAM from MCS: ref #665961
2018-11-29 13:52:05 [INFO    ] Finished processing BAM request
2018-11-29 13:52:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665961   8 58451 49925025 A  ERROR'
2018-11-29 13:52:05 [DEBUG   ] Got command BAM from MCS: ref #665960
2018-11-29 13:52:05 [INFO    ] Finished processing BAM request
2018-11-29 13:52:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665960   8 58451 49925029 A  ERROR'
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:52:05 [DEBUG   ] spawn_process: at 2018-11-29 13:52:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:52:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:52:27 [DEBUG   ] Got command BAM from MCS: ref #665962
2018-11-29 13:52:27 [INFO    ] Finished processing BAM request
2018-11-29 13:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665962   8 58451 49947029 A  ERROR'
2018-11-29 13:52:27 [DEBUG   ] Got command BAM from MCS: ref #665963
2018-11-29 13:52:27 [INFO    ] Finished processing BAM request
2018-11-29 13:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665963   8 58451 49947033 A  ERROR'
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:52:27 [DEBUG   ] spawn_process: at 2018-11-29 13:52:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:52:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:52:49 [DEBUG   ] Got command BAM from MCS: ref #665964
2018-11-29 13:52:49 [INFO    ] Finished processing BAM request
2018-11-29 13:52:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:52:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665964   8 58451 49969033 A  ERROR'
2018-11-29 13:52:49 [DEBUG   ] Got command BAM from MCS: ref #665965
2018-11-29 13:52:49 [INFO    ] Finished processing BAM request
2018-11-29 13:52:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:52:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665965   8 58451 49969037 A  ERROR'
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:52:49 [DEBUG   ] spawn_process: at 2018-11-29 13:52:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:52:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:52:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:52:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:52:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:52:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:52:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:52:59 [DEBUG   ] Finished updating board flags in 1.273 seconds
2018-11-29 13:53:11 [DEBUG   ] Got command BAM from MCS: ref #665970
2018-11-29 13:53:11 [INFO    ] Finished processing BAM request
2018-11-29 13:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665970   8 58451 49991041 A  ERROR'
2018-11-29 13:53:11 [DEBUG   ] Got command BAM from MCS: ref #665971
2018-11-29 13:53:11 [INFO    ] Finished processing BAM request
2018-11-29 13:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665971   8 58451 49991045 A  ERROR'
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:53:11 [DEBUG   ] spawn_process: at 2018-11-29 13:53:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:53:33 [DEBUG   ] Got command BAM from MCS: ref #665973
2018-11-29 13:53:33 [INFO    ] Finished processing BAM request
2018-11-29 13:53:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665973   8 58451 50013029 A  ERROR'
2018-11-29 13:53:33 [DEBUG   ] Got command BAM from MCS: ref #665972
2018-11-29 13:53:33 [INFO    ] Finished processing BAM request
2018-11-29 13:53:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665972   8 58451 50013033 A  ERROR'
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:53:33 [DEBUG   ] spawn_process: at 2018-11-29 13:53:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:53:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:53:54 [DEBUG   ] Got command RPT from MCS: ref #665978
2018-11-29 13:53:54 [DEBUG   ] summary = ERROR
2018-11-29 13:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665978  13 58451 50034465 A  ERRORERROR'
2018-11-29 13:53:54 [DEBUG   ] Got command RPT from MCS: ref #665979
2018-11-29 13:53:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665979  77 58451 50034669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:53:54 [DEBUG   ] Got command RPT from MCS: ref #665980
2018-11-29 13:53:54 [DEBUG   ] summary = ERROR
2018-11-29 13:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665980  13 58451 50034873 A  ERRORERROR'
2018-11-29 13:53:55 [DEBUG   ] Got command BAM from MCS: ref #665977
2018-11-29 13:53:55 [INFO    ] Finished processing BAM request
2018-11-29 13:53:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665977   8 58451 50035033 A  ERROR'
2018-11-29 13:53:55 [DEBUG   ] Got command BAM from MCS: ref #665976
2018-11-29 13:53:55 [INFO    ] Finished processing BAM request
2018-11-29 13:53:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665976   8 58451 50035037 A  ERROR'
2018-11-29 13:53:55 [DEBUG   ] Got command RPT from MCS: ref #665982
2018-11-29 13:53:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665982  77 58451 50035073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:53:55 [DEBUG   ] Got command RPT from MCS: ref #665984
2018-11-29 13:53:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665984  12 58451 50035265 A  ERRORB¤ff'
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:53:55 [DEBUG   ] spawn_process: at 2018-11-29 13:53:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:53:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 13:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 13:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 13:53:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:53:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:53:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:53:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:53:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:53:59 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-11-29 13:54:17 [DEBUG   ] Got command BAM from MCS: ref #665989
2018-11-29 13:54:17 [INFO    ] Finished processing BAM request
2018-11-29 13:54:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665989   8 58451 50057033 A  ERROR'
2018-11-29 13:54:17 [DEBUG   ] Got command BAM from MCS: ref #665988
2018-11-29 13:54:17 [INFO    ] Finished processing BAM request
2018-11-29 13:54:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665988   8 58451 50057037 A  ERROR'
2018-11-29 13:54:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:54:17 [DEBUG   ] spawn_process: at 2018-11-29 13:54:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:54:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:54:39 [DEBUG   ] Got command BAM from MCS: ref #665991
2018-11-29 13:54:39 [INFO    ] Finished processing BAM request
2018-11-29 13:54:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665991   8 58451 50079029 A  ERROR'
2018-11-29 13:54:39 [DEBUG   ] Got command BAM from MCS: ref #665990
2018-11-29 13:54:39 [INFO    ] Finished processing BAM request
2018-11-29 13:54:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665990   8 58451 50079033 A  ERROR'
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:54:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:54:39 [DEBUG   ] spawn_process: at 2018-11-29 13:54:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:54:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 13:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 13:54:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:54:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:54:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:55:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:55:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:55:00 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-11-29 13:55:01 [DEBUG   ] Got command BAM from MCS: ref #665992
2018-11-29 13:55:01 [INFO    ] Finished processing BAM request
2018-11-29 13:55:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665992   8 58451 50101029 A  ERROR'
2018-11-29 13:55:01 [DEBUG   ] Got command BAM from MCS: ref #665993
2018-11-29 13:55:01 [INFO    ] Finished processing BAM request
2018-11-29 13:55:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665993   8 58451 50101033 A  ERROR'
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:55:01 [DEBUG   ] spawn_process: at 2018-11-29 13:55:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:55:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:55:23 [DEBUG   ] Got command BAM from MCS: ref #665995
2018-11-29 13:55:23 [INFO    ] Finished processing BAM request
2018-11-29 13:55:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:55:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665995   8 58451 50123029 A  ERROR'
2018-11-29 13:55:23 [DEBUG   ] Got command BAM from MCS: ref #665994
2018-11-29 13:55:23 [INFO    ] Finished processing BAM request
2018-11-29 13:55:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:55:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665994   8 58451 50123033 A  ERROR'
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:55:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:55:23 [DEBUG   ] spawn_process: at 2018-11-29 13:55:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:55:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:55:45 [DEBUG   ] Got command BAM from MCS: ref #665997
2018-11-29 13:55:45 [INFO    ] Finished processing BAM request
2018-11-29 13:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665997   8 58451 50145025 A  ERROR'
2018-11-29 13:55:45 [DEBUG   ] Got command BAM from MCS: ref #665996
2018-11-29 13:55:45 [INFO    ] Finished processing BAM request
2018-11-29 13:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   665996   8 58451 50145029 A  ERROR'
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:55:45 [DEBUG   ] spawn_process: at 2018-11-29 13:55:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:55:49 [DEBUG   ] Got command RPT from MCS: ref #665998
2018-11-29 13:55:49 [DEBUG   ] summary = ERROR
2018-11-29 13:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665998  13 58451 50149701 A  ERRORERROR'
2018-11-29 13:55:49 [DEBUG   ] Got command RPT from MCS: ref #665999
2018-11-29 13:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   665999  77 58451 50149702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:55:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 13:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 13:56:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:56:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:56:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:56:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:56:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:56:00 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-29 13:56:07 [DEBUG   ] Got command BAM from MCS: ref #666015
2018-11-29 13:56:07 [INFO    ] Finished processing BAM request
2018-11-29 13:56:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666015   8 58451 50167033 A  ERROR'
2018-11-29 13:56:07 [DEBUG   ] Got command BAM from MCS: ref #666016
2018-11-29 13:56:07 [INFO    ] Finished processing BAM request
2018-11-29 13:56:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666016   8 58451 50167041 A  ERROR'
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 13:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 13:56:07 [DEBUG   ] spawn_process: at 2018-11-29 13:56:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 13:56:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:56:29 [DEBUG   ] Got command BAM from MCS: ref #666022
2018-11-29 13:56:29 [INFO    ] Finished processing BAM request
2018-11-29 13:56:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666022   8 58451 50189029 A  ERROR'
2018-11-29 13:56:29 [DEBUG   ] Got command BAM from MCS: ref #666021
2018-11-29 13:56:29 [INFO    ] Finished processing BAM request
2018-11-29 13:56:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666021   8 58451 50189033 A  ERROR'
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:56:29 [DEBUG   ] spawn_process: at 2018-11-29 13:56:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:56:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:56:51 [DEBUG   ] Got command BAM from MCS: ref #666024
2018-11-29 13:56:51 [INFO    ] Finished processing BAM request
2018-11-29 13:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666024   8 58451 50211029 A  ERROR'
2018-11-29 13:56:51 [DEBUG   ] Got command BAM from MCS: ref #666023
2018-11-29 13:56:51 [INFO    ] Finished processing BAM request
2018-11-29 13:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666023   8 58451 50211033 A  ERROR'
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:56:51 [DEBUG   ] spawn_process: at 2018-11-29 13:56:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:56:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:57:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 13:57:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:57:00 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-29 13:57:13 [DEBUG   ] Got command BAM from MCS: ref #666025
2018-11-29 13:57:13 [INFO    ] Finished processing BAM request
2018-11-29 13:57:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666025   8 58451 50233025 A  ERROR'
2018-11-29 13:57:13 [DEBUG   ] Got command BAM from MCS: ref #666026
2018-11-29 13:57:13 [INFO    ] Finished processing BAM request
2018-11-29 13:57:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666026   8 58451 50233029 A  ERROR'
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:57:13 [DEBUG   ] spawn_process: at 2018-11-29 13:57:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:57:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:57:35 [DEBUG   ] Got command BAM from MCS: ref #666028
2018-11-29 13:57:35 [INFO    ] Finished processing BAM request
2018-11-29 13:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666028   8 58451 50255029 A  ERROR'
2018-11-29 13:57:35 [DEBUG   ] Got command BAM from MCS: ref #666027
2018-11-29 13:57:35 [INFO    ] Finished processing BAM request
2018-11-29 13:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666027   8 58451 50255033 A  ERROR'
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:57:35 [DEBUG   ] spawn_process: at 2018-11-29 13:57:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:57:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:57:57 [DEBUG   ] Got command BAM from MCS: ref #666030
2018-11-29 13:57:57 [INFO    ] Finished processing BAM request
2018-11-29 13:57:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:57:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666030   8 58451 50277025 A  ERROR'
2018-11-29 13:57:57 [DEBUG   ] Got command BAM from MCS: ref #666029
2018-11-29 13:57:57 [INFO    ] Finished processing BAM request
2018-11-29 13:57:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:57:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666029   8 58451 50277029 A  ERROR'
2018-11-29 13:57:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:57:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:57:57 [DEBUG   ] spawn_process: at 2018-11-29 13:57:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:57:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 13:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 13:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:57:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 13:57:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:57:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:59 [WARNING ] (13, 1, 'bot')
2018-11-29 13:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:57:59 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-11-29 13:58:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:58:19 [DEBUG   ] Got command BAM from MCS: ref #666032
2018-11-29 13:58:19 [INFO    ] Finished processing BAM request
2018-11-29 13:58:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666032   8 58451 50299029 A  ERROR'
2018-11-29 13:58:19 [DEBUG   ] Got command BAM from MCS: ref #666031
2018-11-29 13:58:19 [INFO    ] Finished processing BAM request
2018-11-29 13:58:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666031   8 58451 50299033 A  ERROR'
2018-11-29 13:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 13:58:19 [DEBUG   ] spawn_process: at 2018-11-29 13:58:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 13:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 13:58:20 [DEBUG   ] spawn_process: at 2018-11-29 13:58:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 13:58:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:58:41 [DEBUG   ] Got command BAM from MCS: ref #666034
2018-11-29 13:58:41 [INFO    ] Finished processing BAM request
2018-11-29 13:58:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666034   8 58451 50321025 A  ERROR'
2018-11-29 13:58:41 [DEBUG   ] Got command BAM from MCS: ref #666033
2018-11-29 13:58:41 [INFO    ] Finished processing BAM request
2018-11-29 13:58:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666033   8 58451 50321029 A  ERROR'
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 13:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 13:58:41 [DEBUG   ] spawn_process: at 2018-11-29 13:58:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 13:58:54 [DEBUG   ] Got command RPT from MCS: ref #666035
2018-11-29 13:58:54 [DEBUG   ] summary = ERROR
2018-11-29 13:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666035  13 58451 50334553 A  ERRORERROR'
2018-11-29 13:58:54 [DEBUG   ] Got command RPT from MCS: ref #666036
2018-11-29 13:58:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666036  77 58451 50334757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:58:54 [DEBUG   ] Got command RPT from MCS: ref #666037
2018-11-29 13:58:54 [DEBUG   ] summary = ERROR
2018-11-29 13:58:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666037  13 58451 50334961 A  ERRORERROR'
2018-11-29 13:58:55 [DEBUG   ] Got command RPT from MCS: ref #666038
2018-11-29 13:58:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 13:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666038  77 58451 50335153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 13:58:55 [DEBUG   ] Got command RPT from MCS: ref #666039
2018-11-29 13:58:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 13:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666039  12 58451 50335357 A  ERRORB¢ff'
2018-11-29 13:58:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 13:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 13:59:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 13:59:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:59:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:59:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:59:00 [WARNING ] (13, 1, 'bot')
2018-11-29 13:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 13:59:00 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-29 13:59:03 [DEBUG   ] Got command BAM from MCS: ref #666041
2018-11-29 13:59:03 [INFO    ] Finished processing BAM request
2018-11-29 13:59:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666041   8 58451 50343033 A  ERROR'
2018-11-29 13:59:03 [DEBUG   ] Got command BAM from MCS: ref #666040
2018-11-29 13:59:03 [INFO    ] Finished processing BAM request
2018-11-29 13:59:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666040   8 58451 50343037 A  ERROR'
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:59:03 [DEBUG   ] spawn_process: at 2018-11-29 13:59:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:59:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 13:59:25 [DEBUG   ] Got command BAM from MCS: ref #666046
2018-11-29 13:59:25 [INFO    ] Finished processing BAM request
2018-11-29 13:59:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666046   8 58451 50365033 A  ERROR'
2018-11-29 13:59:25 [DEBUG   ] Got command BAM from MCS: ref #666047
2018-11-29 13:59:25 [INFO    ] Finished processing BAM request
2018-11-29 13:59:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666047   8 58451 50365037 A  ERROR'
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 13:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 13:59:25 [DEBUG   ] spawn_process: at 2018-11-29 13:59:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 13:59:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:59:47 [DEBUG   ] Got command BAM from MCS: ref #666049
2018-11-29 13:59:47 [INFO    ] Finished processing BAM request
2018-11-29 13:59:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666049   8 58451 50387025 A  ERROR'
2018-11-29 13:59:47 [DEBUG   ] Got command BAM from MCS: ref #666048
2018-11-29 13:59:47 [INFO    ] Finished processing BAM request
2018-11-29 13:59:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 13:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666048   8 58451 50387029 A  ERROR'
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 13:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 13:59:47 [DEBUG   ] spawn_process: at 2018-11-29 13:59:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 13:59:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 13:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:00:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:00:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:00:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:00:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:00:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:00:00 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-29 14:00:09 [DEBUG   ] Got command BAM from MCS: ref #666050
2018-11-29 14:00:09 [INFO    ] Finished processing BAM request
2018-11-29 14:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666050   8 58451 50409033 A  ERROR'
2018-11-29 14:00:09 [DEBUG   ] Got command BAM from MCS: ref #666051
2018-11-29 14:00:09 [INFO    ] Finished processing BAM request
2018-11-29 14:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666051   8 58451 50409037 A  ERROR'
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:00:09 [DEBUG   ] spawn_process: at 2018-11-29 14:00:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:00:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:00:31 [DEBUG   ] Got command BAM from MCS: ref #666053
2018-11-29 14:00:31 [INFO    ] Finished processing BAM request
2018-11-29 14:00:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666053   8 58451 50431033 A  ERROR'
2018-11-29 14:00:31 [DEBUG   ] Got command BAM from MCS: ref #666052
2018-11-29 14:00:31 [INFO    ] Finished processing BAM request
2018-11-29 14:00:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666052   8 58451 50431037 A  ERROR'
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:00:31 [DEBUG   ] spawn_process: at 2018-11-29 14:00:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:00:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:00:49 [DEBUG   ] Got command RPT from MCS: ref #666054
2018-11-29 14:00:49 [DEBUG   ] summary = ERROR
2018-11-29 14:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666054  13 58451 50449697 A  ERRORERROR'
2018-11-29 14:00:49 [DEBUG   ] Got command RPT from MCS: ref #666055
2018-11-29 14:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666055  77 58451 50449698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:00:53 [DEBUG   ] Got command BAM from MCS: ref #666071
2018-11-29 14:00:53 [INFO    ] Finished processing BAM request
2018-11-29 14:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666071   8 58451 50453025 A  ERROR'
2018-11-29 14:00:53 [DEBUG   ] Got command BAM from MCS: ref #666072
2018-11-29 14:00:53 [INFO    ] Finished processing BAM request
2018-11-29 14:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666072   8 58451 50453029 A  ERROR'
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:00:53 [DEBUG   ] spawn_process: at 2018-11-29 14:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:00:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:01:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:01:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:01:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:01:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:01:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:01:00 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-29 14:01:15 [DEBUG   ] Got command BAM from MCS: ref #666073
2018-11-29 14:01:15 [INFO    ] Finished processing BAM request
2018-11-29 14:01:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666073   8 58451 50475033 A  ERROR'
2018-11-29 14:01:15 [DEBUG   ] Got command BAM from MCS: ref #666074
2018-11-29 14:01:15 [INFO    ] Finished processing BAM request
2018-11-29 14:01:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666074   8 58451 50475037 A  ERROR'
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:01:15 [DEBUG   ] spawn_process: at 2018-11-29 14:01:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:01:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:01:37 [DEBUG   ] Got command BAM from MCS: ref #666075
2018-11-29 14:01:37 [INFO    ] Finished processing BAM request
2018-11-29 14:01:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666075   8 58451 50497037 A  ERROR'
2018-11-29 14:01:37 [DEBUG   ] Got command BAM from MCS: ref #666076
2018-11-29 14:01:37 [INFO    ] Finished processing BAM request
2018-11-29 14:01:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666076   8 58451 50497045 A  ERROR'
2018-11-29 14:01:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:01:37 [DEBUG   ] spawn_process: at 2018-11-29 14:01:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:01:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:01:59 [DEBUG   ] Got command BAM from MCS: ref #666077
2018-11-29 14:01:59 [INFO    ] Finished processing BAM request
2018-11-29 14:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666077   8 58451 50519033 A  ERROR'
2018-11-29 14:01:59 [DEBUG   ] Got command BAM from MCS: ref #666078
2018-11-29 14:01:59 [INFO    ] Finished processing BAM request
2018-11-29 14:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666078   8 58451 50519037 A  ERROR'
2018-11-29 14:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 14:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:01:59 [DEBUG   ] spawn_process: at 2018-11-29 14:01:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:02:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:02:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:02:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:02:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:02:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:02:00 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-11-29 14:02:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:02:21 [DEBUG   ] Got command BAM from MCS: ref #666084
2018-11-29 14:02:21 [INFO    ] Finished processing BAM request
2018-11-29 14:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666084   8 58451 50541033 A  ERROR'
2018-11-29 14:02:21 [DEBUG   ] Got command BAM from MCS: ref #666083
2018-11-29 14:02:21 [INFO    ] Finished processing BAM request
2018-11-29 14:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666083   8 58451 50541037 A  ERROR'
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:02:21 [DEBUG   ] spawn_process: at 2018-11-29 14:02:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:02:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:02:43 [DEBUG   ] Got command BAM from MCS: ref #666086
2018-11-29 14:02:43 [INFO    ] Finished processing BAM request
2018-11-29 14:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666086   8 58451 50563033 A  ERROR'
2018-11-29 14:02:43 [DEBUG   ] Got command BAM from MCS: ref #666085
2018-11-29 14:02:43 [INFO    ] Finished processing BAM request
2018-11-29 14:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666085   8 58451 50563037 A  ERROR'
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:02:43 [DEBUG   ] spawn_process: at 2018-11-29 14:02:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:02:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:03:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 14:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:03:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:03:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:03:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:03:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:03:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:03:00 [DEBUG   ] Finished updating board flags in 1.277 seconds
2018-11-29 14:03:05 [DEBUG   ] Got command BAM from MCS: ref #666087
2018-11-29 14:03:05 [INFO    ] Finished processing BAM request
2018-11-29 14:03:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666087   8 58451 50585025 A  ERROR'
2018-11-29 14:03:05 [DEBUG   ] Got command BAM from MCS: ref #666088
2018-11-29 14:03:05 [INFO    ] Finished processing BAM request
2018-11-29 14:03:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666088   8 58451 50585029 A  ERROR'
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:03:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:03:05 [DEBUG   ] spawn_process: at 2018-11-29 14:03:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:03:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:03:27 [DEBUG   ] Got command BAM from MCS: ref #666090
2018-11-29 14:03:27 [INFO    ] Finished processing BAM request
2018-11-29 14:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666090   8 58451 50607037 A  ERROR'
2018-11-29 14:03:27 [DEBUG   ] Got command BAM from MCS: ref #666089
2018-11-29 14:03:27 [INFO    ] Finished processing BAM request
2018-11-29 14:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666089   8 58451 50607045 A  ERROR'
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:03:27 [DEBUG   ] spawn_process: at 2018-11-29 14:03:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:03:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:03:49 [DEBUG   ] Got command BAM from MCS: ref #666094
2018-11-29 14:03:49 [INFO    ] Finished processing BAM request
2018-11-29 14:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666094   8 58451 50629033 A  ERROR'
2018-11-29 14:03:49 [DEBUG   ] Got command BAM from MCS: ref #666093
2018-11-29 14:03:49 [INFO    ] Finished processing BAM request
2018-11-29 14:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666093   8 58451 50629037 A  ERROR'
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:03:49 [DEBUG   ] spawn_process: at 2018-11-29 14:03:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:03:54 [DEBUG   ] Got command RPT from MCS: ref #666095
2018-11-29 14:03:54 [DEBUG   ] summary = ERROR
2018-11-29 14:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666095  13 58451 50634641 A  ERRORERROR'
2018-11-29 14:03:54 [DEBUG   ] Got command RPT from MCS: ref #666096
2018-11-29 14:03:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:03:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666096  77 58451 50634845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:03:55 [DEBUG   ] Got command RPT from MCS: ref #666097
2018-11-29 14:03:55 [DEBUG   ] summary = ERROR
2018-11-29 14:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666097  13 58451 50635037 A  ERRORERROR'
2018-11-29 14:03:55 [DEBUG   ] Got command RPT from MCS: ref #666099
2018-11-29 14:03:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666099  77 58451 50635241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:03:55 [DEBUG   ] Got command RPT from MCS: ref #666100
2018-11-29 14:03:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666100  12 58451 50635445 A  ERRORB¢ff'
2018-11-29 14:03:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 14:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:04:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:04:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:04:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:04:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:04:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:04:01 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-11-29 14:04:11 [DEBUG   ] Got command BAM from MCS: ref #666106
2018-11-29 14:04:11 [INFO    ] Finished processing BAM request
2018-11-29 14:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666106   8 58451 50651025 A  ERROR'
2018-11-29 14:04:11 [DEBUG   ] Got command BAM from MCS: ref #666105
2018-11-29 14:04:11 [INFO    ] Finished processing BAM request
2018-11-29 14:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666105   8 58451 50651029 A  ERROR'
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:04:11 [DEBUG   ] spawn_process: at 2018-11-29 14:04:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:04:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:04:33 [DEBUG   ] Got command BAM from MCS: ref #666107
2018-11-29 14:04:33 [INFO    ] Finished processing BAM request
2018-11-29 14:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666107   8 58451 50673029 A  ERROR'
2018-11-29 14:04:33 [DEBUG   ] Got command BAM from MCS: ref #666108
2018-11-29 14:04:33 [INFO    ] Finished processing BAM request
2018-11-29 14:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666108   8 58451 50673033 A  ERROR'
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:04:33 [DEBUG   ] spawn_process: at 2018-11-29 14:04:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:04:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:04:55 [DEBUG   ] Got command BAM from MCS: ref #666110
2018-11-29 14:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666110   8 58451 50695025 A  ERROR'
2018-11-29 14:04:55 [DEBUG   ] Got command BAM from MCS: ref #666109
2018-11-29 14:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666109   8 58451 50695029 A  ERROR'
2018-11-29 14:04:55 [INFO    ] Finished processing BAM request
2018-11-29 14:04:55 [INFO    ] Finished processing BAM request
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:04:55 [DEBUG   ] spawn_process: at 2018-11-29 14:04:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:04:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 14:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 14:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 14:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 14:05:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:05:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:05:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:05:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:05:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:05:01 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-29 14:05:17 [DEBUG   ] Got command BAM from MCS: ref #666115
2018-11-29 14:05:17 [INFO    ] Finished processing BAM request
2018-11-29 14:05:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666115   8 58451 50717025 A  ERROR'
2018-11-29 14:05:17 [DEBUG   ] Got command BAM from MCS: ref #666116
2018-11-29 14:05:17 [INFO    ] Finished processing BAM request
2018-11-29 14:05:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666116   8 58451 50717029 A  ERROR'
2018-11-29 14:05:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:05:17 [DEBUG   ] spawn_process: at 2018-11-29 14:05:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:05:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:05:39 [DEBUG   ] Got command BAM from MCS: ref #666117
2018-11-29 14:05:39 [INFO    ] Finished processing BAM request
2018-11-29 14:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666117   8 58451 50739025 A  ERROR'
2018-11-29 14:05:39 [DEBUG   ] Got command BAM from MCS: ref #666118
2018-11-29 14:05:39 [INFO    ] Finished processing BAM request
2018-11-29 14:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666118   8 58451 50739029 A  ERROR'
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:05:39 [DEBUG   ] spawn_process: at 2018-11-29 14:05:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:05:49 [DEBUG   ] Got command RPT from MCS: ref #666119
2018-11-29 14:05:49 [DEBUG   ] summary = ERROR
2018-11-29 14:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666119  13 58451 50749705 A  ERRORERROR'
2018-11-29 14:05:49 [DEBUG   ] Got command RPT from MCS: ref #666120
2018-11-29 14:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666120  77 58451 50749706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:05:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:06:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 14:06:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 14:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:06:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:06:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 14:06:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:06:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:06:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:06:00 [WARNING ] (13, 1, 'bot')
2018-11-29 14:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:06:00 [DEBUG   ] Finished updating board flags in 1.043 seconds
2018-11-29 14:06:01 [DEBUG   ] Got command BAM from MCS: ref #666137
2018-11-29 14:06:01 [INFO    ] Finished processing BAM request
2018-11-29 14:06:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666137   8 58451 50761025 A  ERROR'
2018-11-29 14:06:01 [DEBUG   ] Got command BAM from MCS: ref #666136
2018-11-29 14:06:01 [INFO    ] Finished processing BAM request
2018-11-29 14:06:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666136   8 58451 50761029 A  ERROR'
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:06:01 [DEBUG   ] spawn_process: at 2018-11-29 14:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:06:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:06:23 [DEBUG   ] Got command BAM from MCS: ref #666139
2018-11-29 14:06:23 [INFO    ] Finished processing BAM request
2018-11-29 14:06:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666139   8 58451 50783033 A  ERROR'
2018-11-29 14:06:23 [DEBUG   ] Got command BAM from MCS: ref #666138
2018-11-29 14:06:23 [INFO    ] Finished processing BAM request
2018-11-29 14:06:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666138   8 58451 50783037 A  ERROR'
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:06:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:06:23 [DEBUG   ] spawn_process: at 2018-11-29 14:06:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:06:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:06:45 [DEBUG   ] Got command BAM from MCS: ref #666140
2018-11-29 14:06:45 [INFO    ] Finished processing BAM request
2018-11-29 14:06:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666140   8 58451 50805025 A  ERROR'
2018-11-29 14:06:45 [DEBUG   ] Got command BAM from MCS: ref #666141
2018-11-29 14:06:45 [INFO    ] Finished processing BAM request
2018-11-29 14:06:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666141   8 58451 50805029 A  ERROR'
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:06:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:06:45 [DEBUG   ] spawn_process: at 2018-11-29 14:06:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:06:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:07:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 14:07:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:07:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:07:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:07:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:07:01 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-29 14:07:07 [DEBUG   ] Got command BAM from MCS: ref #666142
2018-11-29 14:07:07 [INFO    ] Finished processing BAM request
2018-11-29 14:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666142   8 58451 50827025 A  ERROR'
2018-11-29 14:07:07 [DEBUG   ] Got command BAM from MCS: ref #666143
2018-11-29 14:07:07 [INFO    ] Finished processing BAM request
2018-11-29 14:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666143   8 58451 50827029 A  ERROR'
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:07:07 [DEBUG   ] spawn_process: at 2018-11-29 14:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:07:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:07:29 [DEBUG   ] Got command BAM from MCS: ref #666144
2018-11-29 14:07:29 [INFO    ] Finished processing BAM request
2018-11-29 14:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666144   8 58451 50849033 A  ERROR'
2018-11-29 14:07:29 [DEBUG   ] Got command BAM from MCS: ref #666145
2018-11-29 14:07:29 [INFO    ] Finished processing BAM request
2018-11-29 14:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666145   8 58451 50849037 A  ERROR'
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:07:29 [DEBUG   ] spawn_process: at 2018-11-29 14:07:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:07:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:07:51 [DEBUG   ] Got command BAM from MCS: ref #666146
2018-11-29 14:07:51 [INFO    ] Finished processing BAM request
2018-11-29 14:07:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:07:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666146   8 58451 50871037 A  ERROR'
2018-11-29 14:07:51 [DEBUG   ] Got command BAM from MCS: ref #666147
2018-11-29 14:07:51 [INFO    ] Finished processing BAM request
2018-11-29 14:07:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:07:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666147   8 58451 50871041 A  ERROR'
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:07:51 [DEBUG   ] spawn_process: at 2018-11-29 14:07:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:07:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 14:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:08:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:08:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:08:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:08:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:08:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:08:01 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-29 14:08:13 [DEBUG   ] Got command BAM from MCS: ref #666152
2018-11-29 14:08:13 [INFO    ] Finished processing BAM request
2018-11-29 14:08:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666152   8 58451 50893029 A  ERROR'
2018-11-29 14:08:13 [DEBUG   ] Got command BAM from MCS: ref #666153
2018-11-29 14:08:13 [INFO    ] Finished processing BAM request
2018-11-29 14:08:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666153   8 58451 50893033 A  ERROR'
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:08:13 [DEBUG   ] spawn_process: at 2018-11-29 14:08:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:08:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:08:35 [DEBUG   ] Got command BAM from MCS: ref #666154
2018-11-29 14:08:35 [INFO    ] Finished processing BAM request
2018-11-29 14:08:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666154   8 58451 50915029 A  ERROR'
2018-11-29 14:08:35 [DEBUG   ] Got command BAM from MCS: ref #666155
2018-11-29 14:08:35 [INFO    ] Finished processing BAM request
2018-11-29 14:08:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666155   8 58451 50915033 A  ERROR'
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:08:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:08:35 [DEBUG   ] spawn_process: at 2018-11-29 14:08:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:08:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:08:54 [DEBUG   ] Got command RPT from MCS: ref #666156
2018-11-29 14:08:54 [DEBUG   ] summary = ERROR
2018-11-29 14:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666156  13 58451 50934721 A  ERRORERROR'
2018-11-29 14:08:54 [DEBUG   ] Got command RPT from MCS: ref #666157
2018-11-29 14:08:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666157  77 58451 50934925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:08:55 [DEBUG   ] Got command RPT from MCS: ref #666158
2018-11-29 14:08:55 [DEBUG   ] summary = ERROR
2018-11-29 14:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666158  13 58451 50935129 A  ERRORERROR'
2018-11-29 14:08:55 [DEBUG   ] Got command RPT from MCS: ref #666159
2018-11-29 14:08:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666159  77 58451 50935333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:08:55 [DEBUG   ] Got command RPT from MCS: ref #666160
2018-11-29 14:08:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666160  12 58451 50935525 A  ERRORB£ff'
2018-11-29 14:08:57 [DEBUG   ] Got command BAM from MCS: ref #666162
2018-11-29 14:08:57 [INFO    ] Finished processing BAM request
2018-11-29 14:08:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666162   8 58451 50937025 A  ERROR'
2018-11-29 14:08:57 [DEBUG   ] Got command BAM from MCS: ref #666161
2018-11-29 14:08:57 [INFO    ] Finished processing BAM request
2018-11-29 14:08:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666161   8 58451 50937029 A  ERROR'
2018-11-29 14:08:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:08:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:08:57 [DEBUG   ] spawn_process: at 2018-11-29 14:08:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:09:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 14:09:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 14:09:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:09:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:09:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:09:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:09:01 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-11-29 14:09:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:09:19 [DEBUG   ] Got command BAM from MCS: ref #666163
2018-11-29 14:09:19 [INFO    ] Finished processing BAM request
2018-11-29 14:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666163   8 58451 50959029 A  ERROR'
2018-11-29 14:09:19 [DEBUG   ] Got command BAM from MCS: ref #666164
2018-11-29 14:09:19 [INFO    ] Finished processing BAM request
2018-11-29 14:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666164   8 58451 50959033 A  ERROR'
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:09:19 [DEBUG   ] spawn_process: at 2018-11-29 14:09:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:09:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:09:41 [DEBUG   ] Got command BAM from MCS: ref #666166
2018-11-29 14:09:41 [INFO    ] Finished processing BAM request
2018-11-29 14:09:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666166   8 58451 50981025 A  ERROR'
2018-11-29 14:09:41 [DEBUG   ] Got command BAM from MCS: ref #666165
2018-11-29 14:09:41 [INFO    ] Finished processing BAM request
2018-11-29 14:09:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666165   8 58451 50981029 A  ERROR'
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:09:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:09:41 [DEBUG   ] spawn_process: at 2018-11-29 14:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:09:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:10:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:10:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:10:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:10:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:10:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:10:01 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-29 14:10:03 [DEBUG   ] Got command BAM from MCS: ref #666167
2018-11-29 14:10:03 [INFO    ] Finished processing BAM request
2018-11-29 14:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666167   8 58451 51003029 A  ERROR'
2018-11-29 14:10:03 [DEBUG   ] Got command BAM from MCS: ref #666168
2018-11-29 14:10:03 [INFO    ] Finished processing BAM request
2018-11-29 14:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666168   8 58451 51003033 A  ERROR'
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:10:03 [DEBUG   ] spawn_process: at 2018-11-29 14:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:10:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:10:25 [DEBUG   ] Got command BAM from MCS: ref #666170
2018-11-29 14:10:25 [INFO    ] Finished processing BAM request
2018-11-29 14:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666170   8 58451 51025029 A  ERROR'
2018-11-29 14:10:25 [DEBUG   ] Got command BAM from MCS: ref #666169
2018-11-29 14:10:25 [INFO    ] Finished processing BAM request
2018-11-29 14:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666169   8 58451 51025033 A  ERROR'
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:10:25 [DEBUG   ] spawn_process: at 2018-11-29 14:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:10:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:10:48 [DEBUG   ] Got command BAM from MCS: ref #666172
2018-11-29 14:10:48 [INFO    ] Finished processing BAM request
2018-11-29 14:10:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666172   8 58451 51048025 A  ERROR'
2018-11-29 14:10:48 [DEBUG   ] Got command BAM from MCS: ref #666171
2018-11-29 14:10:48 [INFO    ] Finished processing BAM request
2018-11-29 14:10:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666171   8 58451 51048029 A  ERROR'
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:10:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:10:48 [DEBUG   ] spawn_process: at 2018-11-29 14:10:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:10:49 [DEBUG   ] Got command RPT from MCS: ref #666173
2018-11-29 14:10:49 [DEBUG   ] summary = ERROR
2018-11-29 14:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666173  13 58451 51049705 A  ERRORERROR'
2018-11-29 14:10:49 [DEBUG   ] Got command RPT from MCS: ref #666174
2018-11-29 14:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666174  77 58451 51049706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:10:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:11:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 14:11:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:11:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:11:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:11:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:11:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:11:01 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-29 14:11:11 [DEBUG   ] Got command BAM from MCS: ref #666194
2018-11-29 14:11:11 [INFO    ] Finished processing BAM request
2018-11-29 14:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666194   8 58451 51071033 A  ERROR'
2018-11-29 14:11:11 [DEBUG   ] Got command BAM from MCS: ref #666195
2018-11-29 14:11:11 [INFO    ] Finished processing BAM request
2018-11-29 14:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666195   8 58451 51071037 A  ERROR'
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:11:11 [DEBUG   ] spawn_process: at 2018-11-29 14:11:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:11:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:11:34 [DEBUG   ] Got command BAM from MCS: ref #666196
2018-11-29 14:11:34 [INFO    ] Finished processing BAM request
2018-11-29 14:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666196   8 58451 51094029 A  ERROR'
2018-11-29 14:11:34 [DEBUG   ] Got command BAM from MCS: ref #666197
2018-11-29 14:11:34 [INFO    ] Finished processing BAM request
2018-11-29 14:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666197   8 58451 51094033 A  ERROR'
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:11:34 [DEBUG   ] spawn_process: at 2018-11-29 14:11:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:11:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:11:57 [DEBUG   ] Got command BAM from MCS: ref #666199
2018-11-29 14:11:57 [INFO    ] Finished processing BAM request
2018-11-29 14:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666199   8 58451 51117025 A  ERROR'
2018-11-29 14:11:57 [DEBUG   ] Got command BAM from MCS: ref #666198
2018-11-29 14:11:57 [INFO    ] Finished processing BAM request
2018-11-29 14:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666198   8 58451 51117029 A  ERROR'
2018-11-29 14:11:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:11:57 [DEBUG   ] spawn_process: at 2018-11-29 14:11:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-29 14:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:12:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:12:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:12:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:12:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:12:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:12:01 [DEBUG   ] Finished updating board flags in 1.164 seconds
2018-11-29 14:12:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:12:20 [DEBUG   ] Got command BAM from MCS: ref #666201
2018-11-29 14:12:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666201   8 58451 51140166 A  ERROR'
2018-11-29 14:12:20 [DEBUG   ] Got command BAM from MCS: ref #666200
2018-11-29 14:12:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666200   8 58451 51140170 A  ERROR'
2018-11-29 14:12:20 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-29 14:12:20 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-29 14:12:20 [INFO    ] Finished processing BAM request
2018-11-29 14:12:20 [INFO    ] Finished processing BAM request
2018-11-29 14:12:20 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-29 14:12:20 [DEBUG   ] 
2018-11-29 14:12:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:12:43 [DEBUG   ] Got command BAM from MCS: ref #666202
2018-11-29 14:12:43 [INFO    ] Finished processing BAM request
2018-11-29 14:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666202   8 58451 51163034 A  ERROR'
2018-11-29 14:12:43 [DEBUG   ] Got command BAM from MCS: ref #666203
2018-11-29 14:12:43 [INFO    ] Finished processing BAM request
2018-11-29 14:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666203   8 58451 51163038 A  ERROR'
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:12:43 [DEBUG   ] spawn_process: at 2018-11-29 14:12:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:12:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:13:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 14:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:13:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:13:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 14:13:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:13:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:13:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:13:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:13:01 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-29 14:13:06 [DEBUG   ] Got command BAM from MCS: ref #666205
2018-11-29 14:13:06 [INFO    ] Finished processing BAM request
2018-11-29 14:13:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666205   8 58451 51186025 A  ERROR'
2018-11-29 14:13:06 [DEBUG   ] Got command BAM from MCS: ref #666204
2018-11-29 14:13:06 [INFO    ] Finished processing BAM request
2018-11-29 14:13:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666204   8 58451 51186029 A  ERROR'
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:13:06 [DEBUG   ] spawn_process: at 2018-11-29 14:13:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:13:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:13:29 [DEBUG   ] Got command BAM from MCS: ref #666206
2018-11-29 14:13:29 [INFO    ] Finished processing BAM request
2018-11-29 14:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666206   8 58451 51209025 A  ERROR'
2018-11-29 14:13:29 [DEBUG   ] Got command BAM from MCS: ref #666207
2018-11-29 14:13:29 [INFO    ] Finished processing BAM request
2018-11-29 14:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666207   8 58451 51209029 A  ERROR'
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:13:29 [DEBUG   ] spawn_process: at 2018-11-29 14:13:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:13:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:13:52 [DEBUG   ] Got command BAM from MCS: ref #666211
2018-11-29 14:13:52 [INFO    ] Finished processing BAM request
2018-11-29 14:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666211   8 58451 51232029 A  ERROR'
2018-11-29 14:13:52 [DEBUG   ] Got command BAM from MCS: ref #666210
2018-11-29 14:13:52 [INFO    ] Finished processing BAM request
2018-11-29 14:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666210   8 58451 51232033 A  ERROR'
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:13:52 [DEBUG   ] spawn_process: at 2018-11-29 14:13:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:13:54 [DEBUG   ] Got command RPT from MCS: ref #666212
2018-11-29 14:13:54 [DEBUG   ] summary = ERROR
2018-11-29 14:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666212  13 58451 51234817 A  ERRORERROR'
2018-11-29 14:13:55 [DEBUG   ] Got command RPT from MCS: ref #666213
2018-11-29 14:13:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666213  77 58451 51235009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:13:55 [DEBUG   ] Got command RPT from MCS: ref #666214
2018-11-29 14:13:55 [DEBUG   ] summary = ERROR
2018-11-29 14:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666214  13 58451 51235213 A  ERRORERROR'
2018-11-29 14:13:55 [DEBUG   ] Got command RPT from MCS: ref #666216
2018-11-29 14:13:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666216  77 58451 51235417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:13:55 [DEBUG   ] Got command RPT from MCS: ref #666217
2018-11-29 14:13:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666217  12 58451 51235621 A  ERRORB¢ff'
2018-11-29 14:13:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:14:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 14:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:14:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 14:14:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:14:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:14:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:14:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:14:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:14:01 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-29 14:14:15 [DEBUG   ] Got command BAM from MCS: ref #666226
2018-11-29 14:14:15 [INFO    ] Finished processing BAM request
2018-11-29 14:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666226   8 58451 51255033 A  ERROR'
2018-11-29 14:14:15 [DEBUG   ] Got command BAM from MCS: ref #666227
2018-11-29 14:14:15 [INFO    ] Finished processing BAM request
2018-11-29 14:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666227   8 58451 51255037 A  ERROR'
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:14:15 [DEBUG   ] spawn_process: at 2018-11-29 14:14:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:14:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:14:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:14:38 [DEBUG   ] Got command BAM from MCS: ref #666229
2018-11-29 14:14:38 [INFO    ] Finished processing BAM request
2018-11-29 14:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666229   8 58451 51278033 A  ERROR'
2018-11-29 14:14:38 [DEBUG   ] Got command BAM from MCS: ref #666228
2018-11-29 14:14:38 [INFO    ] Finished processing BAM request
2018-11-29 14:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666228   8 58451 51278037 A  ERROR'
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:14:38 [DEBUG   ] spawn_process: at 2018-11-29 14:14:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:14:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:15:01 [DEBUG   ] Got command BAM from MCS: ref #666230
2018-11-29 14:15:01 [INFO    ] Finished processing BAM request
2018-11-29 14:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666230   8 58451 51301033 A  ERROR'
2018-11-29 14:15:01 [DEBUG   ] Got command BAM from MCS: ref #666231
2018-11-29 14:15:01 [INFO    ] Finished processing BAM request
2018-11-29 14:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666231   8 58451 51301037 A  ERROR'
2018-11-29 14:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:15:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:15:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:15:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:15:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:15:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:15:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:15:01 [DEBUG   ] Finished updating board flags in 1.288 seconds
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:15:01 [DEBUG   ] spawn_process: at 2018-11-29 14:15:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:15:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:15:24 [DEBUG   ] Got command BAM from MCS: ref #666232
2018-11-29 14:15:24 [INFO    ] Finished processing BAM request
2018-11-29 14:15:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666232   8 58451 51324029 A  ERROR'
2018-11-29 14:15:24 [DEBUG   ] Got command BAM from MCS: ref #666233
2018-11-29 14:15:24 [INFO    ] Finished processing BAM request
2018-11-29 14:15:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:15:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666233   8 58451 51324033 A  ERROR'
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:15:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:15:24 [DEBUG   ] spawn_process: at 2018-11-29 14:15:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:15:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:15:47 [DEBUG   ] Got command BAM from MCS: ref #666234
2018-11-29 14:15:47 [INFO    ] Finished processing BAM request
2018-11-29 14:15:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:15:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666234   8 58451 51347033 A  ERROR'
2018-11-29 14:15:47 [DEBUG   ] Got command BAM from MCS: ref #666235
2018-11-29 14:15:47 [INFO    ] Finished processing BAM request
2018-11-29 14:15:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:15:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666235   8 58451 51347037 A  ERROR'
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:15:47 [DEBUG   ] spawn_process: at 2018-11-29 14:15:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:15:49 [DEBUG   ] Got command RPT from MCS: ref #666236
2018-11-29 14:15:49 [DEBUG   ] summary = ERROR
2018-11-29 14:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666236  13 58451 51349701 A  ERRORERROR'
2018-11-29 14:15:49 [DEBUG   ] Got command RPT from MCS: ref #666237
2018-11-29 14:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666237  77 58451 51349702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:15:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 14:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:16:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:16:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:16:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:16:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:16:01 [WARNING ] (13, 1, 'bot')
2018-11-29 14:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:16:01 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-29 14:16:10 [DEBUG   ] Got command BAM from MCS: ref #666254
2018-11-29 14:16:10 [INFO    ] Finished processing BAM request
2018-11-29 14:16:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666254   8 58451 51370029 A  ERROR'
2018-11-29 14:16:10 [DEBUG   ] Got command BAM from MCS: ref #666253
2018-11-29 14:16:10 [INFO    ] Finished processing BAM request
2018-11-29 14:16:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:16:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666253   8 58451 51370033 A  ERROR'
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:16:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:16:10 [DEBUG   ] spawn_process: at 2018-11-29 14:16:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:16:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:16:33 [DEBUG   ] Got command BAM from MCS: ref #666256
2018-11-29 14:16:33 [INFO    ] Finished processing BAM request
2018-11-29 14:16:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666256   8 58451 51393029 A  ERROR'
2018-11-29 14:16:33 [DEBUG   ] Got command BAM from MCS: ref #666255
2018-11-29 14:16:33 [INFO    ] Finished processing BAM request
2018-11-29 14:16:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666255   8 58451 51393033 A  ERROR'
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:16:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:16:33 [DEBUG   ] spawn_process: at 2018-11-29 14:16:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:16:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:16:56 [DEBUG   ] Got command BAM from MCS: ref #666257
2018-11-29 14:16:56 [INFO    ] Finished processing BAM request
2018-11-29 14:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666257   8 58451 51416029 A  ERROR'
2018-11-29 14:16:56 [DEBUG   ] Got command BAM from MCS: ref #666258
2018-11-29 14:16:56 [INFO    ] Finished processing BAM request
2018-11-29 14:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666258   8 58451 51416033 A  ERROR'
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:16:56 [DEBUG   ] spawn_process: at 2018-11-29 14:16:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:16:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 14:17:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:17:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:17:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:17:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:17:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:17:02 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-11-29 14:17:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:17:19 [DEBUG   ] Got command BAM from MCS: ref #666264
2018-11-29 14:17:19 [INFO    ] Finished processing BAM request
2018-11-29 14:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666264   8 58451 51439029 A  ERROR'
2018-11-29 14:17:19 [DEBUG   ] Got command BAM from MCS: ref #666263
2018-11-29 14:17:19 [INFO    ] Finished processing BAM request
2018-11-29 14:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666263   8 58451 51439033 A  ERROR'
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:17:19 [DEBUG   ] spawn_process: at 2018-11-29 14:17:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:17:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:17:42 [DEBUG   ] Got command BAM from MCS: ref #666266
2018-11-29 14:17:42 [INFO    ] Finished processing BAM request
2018-11-29 14:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666266   8 58451 51462029 A  ERROR'
2018-11-29 14:17:42 [DEBUG   ] Got command BAM from MCS: ref #666265
2018-11-29 14:17:42 [INFO    ] Finished processing BAM request
2018-11-29 14:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666265   8 58451 51462033 A  ERROR'
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:17:42 [DEBUG   ] spawn_process: at 2018-11-29 14:17:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:17:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 14:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 14:18:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:18:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 14:18:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:18:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:18:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:18:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:18:02 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-11-29 14:18:05 [DEBUG   ] Got command BAM from MCS: ref #666268
2018-11-29 14:18:05 [INFO    ] Finished processing BAM request
2018-11-29 14:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666268   8 58451 51485033 A  ERROR'
2018-11-29 14:18:05 [DEBUG   ] Got command BAM from MCS: ref #666267
2018-11-29 14:18:05 [INFO    ] Finished processing BAM request
2018-11-29 14:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666267   8 58451 51485037 A  ERROR'
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:18:05 [DEBUG   ] spawn_process: at 2018-11-29 14:18:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:18:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:18:28 [DEBUG   ] Got command BAM from MCS: ref #666270
2018-11-29 14:18:28 [INFO    ] Finished processing BAM request
2018-11-29 14:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666270   8 58451 51508029 A  ERROR'
2018-11-29 14:18:28 [DEBUG   ] Got command BAM from MCS: ref #666269
2018-11-29 14:18:28 [INFO    ] Finished processing BAM request
2018-11-29 14:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666269   8 58451 51508033 A  ERROR'
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:18:28 [DEBUG   ] spawn_process: at 2018-11-29 14:18:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:18:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:18:52 [DEBUG   ] Got command BAM from MCS: ref #666272
2018-11-29 14:18:52 [INFO    ] Finished processing BAM request
2018-11-29 14:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666272   8 58451 51532029 A  ERROR'
2018-11-29 14:18:52 [DEBUG   ] Got command BAM from MCS: ref #666271
2018-11-29 14:18:52 [INFO    ] Finished processing BAM request
2018-11-29 14:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666271   8 58451 51532033 A  ERROR'
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:18:52 [DEBUG   ] spawn_process: at 2018-11-29 14:18:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:18:54 [DEBUG   ] Got command RPT from MCS: ref #666273
2018-11-29 14:18:54 [DEBUG   ] summary = ERROR
2018-11-29 14:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666273  13 58451 51534902 A  ERRORERROR'
2018-11-29 14:18:55 [DEBUG   ] Got command RPT from MCS: ref #666274
2018-11-29 14:18:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666274  77 58451 51535093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:18:55 [DEBUG   ] Got command RPT from MCS: ref #666275
2018-11-29 14:18:55 [DEBUG   ] summary = ERROR
2018-11-29 14:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666275  13 58451 51535297 A  ERRORERROR'
2018-11-29 14:18:55 [DEBUG   ] Got command RPT from MCS: ref #666276
2018-11-29 14:18:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666276  77 58451 51535501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:18:55 [DEBUG   ] Got command RPT from MCS: ref #666277
2018-11-29 14:18:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666277  12 58451 51535705 A  ERRORB£ff'
2018-11-29 14:18:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 14:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:19:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 14:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 14:19:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:19:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:19:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:19:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:19:02 [DEBUG   ] Finished updating board flags in 1.341 seconds
2018-11-29 14:19:16 [DEBUG   ] Got command BAM from MCS: ref #666279
2018-11-29 14:19:16 [INFO    ] Finished processing BAM request
2018-11-29 14:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666279   8 58451 51556029 A  ERROR'
2018-11-29 14:19:16 [DEBUG   ] Got command BAM from MCS: ref #666278
2018-11-29 14:19:16 [INFO    ] Finished processing BAM request
2018-11-29 14:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666278   8 58451 51556033 A  ERROR'
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:19:16 [DEBUG   ] spawn_process: at 2018-11-29 14:19:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:19:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:19:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:19:40 [DEBUG   ] Got command BAM from MCS: ref #666280
2018-11-29 14:19:40 [INFO    ] Finished processing BAM request
2018-11-29 14:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666280   8 58451 51580029 A  ERROR'
2018-11-29 14:19:40 [DEBUG   ] Got command BAM from MCS: ref #666281
2018-11-29 14:19:40 [INFO    ] Finished processing BAM request
2018-11-29 14:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666281   8 58451 51580033 A  ERROR'
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:19:40 [DEBUG   ] spawn_process: at 2018-11-29 14:19:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:19:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 14:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:20:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:20:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 14:20:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:20:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:20:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:20:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:20:02 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-29 14:20:04 [DEBUG   ] Got command BAM from MCS: ref #666282
2018-11-29 14:20:04 [INFO    ] Finished processing BAM request
2018-11-29 14:20:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666282   8 58451 51604029 A  ERROR'
2018-11-29 14:20:04 [DEBUG   ] Got command BAM from MCS: ref #666283
2018-11-29 14:20:04 [INFO    ] Finished processing BAM request
2018-11-29 14:20:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666283   8 58451 51604033 A  ERROR'
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:20:04 [DEBUG   ] spawn_process: at 2018-11-29 14:20:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:20:17 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-29 14:20:28 [DEBUG   ] Got command BAM from MCS: ref #666289
2018-11-29 14:20:28 [INFO    ] Finished processing BAM request
2018-11-29 14:20:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666289   8 58451 51628029 A  ERROR'
2018-11-29 14:20:28 [DEBUG   ] Got command BAM from MCS: ref #666288
2018-11-29 14:20:28 [INFO    ] Finished processing BAM request
2018-11-29 14:20:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666288   8 58451 51628033 A  ERROR'
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:20:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:20:28 [DEBUG   ] spawn_process: at 2018-11-29 14:20:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:20:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 14:20:49 [DEBUG   ] Got command RPT from MCS: ref #666290
2018-11-29 14:20:49 [DEBUG   ] summary = ERROR
2018-11-29 14:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666290  13 58451 51649701 A  ERRORERROR'
2018-11-29 14:20:49 [DEBUG   ] Got command RPT from MCS: ref #666291
2018-11-29 14:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666291  77 58451 51649702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:20:52 [DEBUG   ] Got command BAM from MCS: ref #666307
2018-11-29 14:20:52 [INFO    ] Finished processing BAM request
2018-11-29 14:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666307   8 58451 51652025 A  ERROR'
2018-11-29 14:20:52 [DEBUG   ] Got command BAM from MCS: ref #666308
2018-11-29 14:20:52 [INFO    ] Finished processing BAM request
2018-11-29 14:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666308   8 58451 51652029 A  ERROR'
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 14:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 14:20:52 [DEBUG   ] spawn_process: at 2018-11-29 14:20:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 14:20:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 14:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 14:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 14:21:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 14:21:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:21:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:21:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:21:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:21:02 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-29 14:21:16 [DEBUG   ] Got command BAM from MCS: ref #666310
2018-11-29 14:21:16 [INFO    ] Finished processing BAM request
2018-11-29 14:21:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666310   8 58451 51676033 A  ERROR'
2018-11-29 14:21:16 [DEBUG   ] Got command BAM from MCS: ref #666309
2018-11-29 14:21:16 [INFO    ] Finished processing BAM request
2018-11-29 14:21:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666309   8 58451 51676037 A  ERROR'
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 14:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 14:21:16 [DEBUG   ] spawn_process: at 2018-11-29 14:21:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 14:21:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 14:21:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 14:21:40 [DEBUG   ] Got command BAM from MCS: ref #666311
2018-11-29 14:21:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666311   8 58451 51700029 A  ERROR'
2018-11-29 14:21:40 [DEBUG   ] Got command BAM from MCS: ref #666312
2018-11-29 14:21:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666312   8 58451 51700033 A  ERROR'
2018-11-29 14:21:40 [INFO    ] Finished processing BAM request
2018-11-29 14:21:40 [INFO    ] Finished processing BAM request
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:21:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:21:40 [DEBUG   ] spawn_process: at 2018-11-29 14:21:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:21:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 14:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 14:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 14:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:22:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 14:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 14:22:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:22:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:22:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:22:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:22:02 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-29 14:22:04 [DEBUG   ] Got command BAM from MCS: ref #666313
2018-11-29 14:22:04 [INFO    ] Finished processing BAM request
2018-11-29 14:22:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:22:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666313   8 58451 51724029 A  ERROR'
2018-11-29 14:22:04 [DEBUG   ] Got command BAM from MCS: ref #666314
2018-11-29 14:22:04 [INFO    ] Finished processing BAM request
2018-11-29 14:22:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:22:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666314   8 58451 51724033 A  ERROR'
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:22:04 [DEBUG   ] spawn_process: at 2018-11-29 14:22:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:22:17 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 14:22:28 [DEBUG   ] Got command BAM from MCS: ref #666315
2018-11-29 14:22:28 [INFO    ] Finished processing BAM request
2018-11-29 14:22:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666315   8 58451 51748029 A  ERROR'
2018-11-29 14:22:28 [DEBUG   ] Got command BAM from MCS: ref #666316
2018-11-29 14:22:28 [INFO    ] Finished processing BAM request
2018-11-29 14:22:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666316   8 58451 51748033 A  ERROR'
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:22:28 [DEBUG   ] spawn_process: at 2018-11-29 14:22:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:22:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 14:22:52 [DEBUG   ] Got command BAM from MCS: ref #666317
2018-11-29 14:22:52 [INFO    ] Finished processing BAM request
2018-11-29 14:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666317   8 58451 51772025 A  ERROR'
2018-11-29 14:22:52 [DEBUG   ] Got command BAM from MCS: ref #666318
2018-11-29 14:22:52 [INFO    ] Finished processing BAM request
2018-11-29 14:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666318   8 58451 51772029 A  ERROR'
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 14:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 14:22:52 [DEBUG   ] spawn_process: at 2018-11-29 14:22:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 14:22:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 14:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 14:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 14:23:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 14:23:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 14:23:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:23:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:23:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:23:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:23:02 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-29 14:23:16 [DEBUG   ] Got command BAM from MCS: ref #666324
2018-11-29 14:23:16 [INFO    ] Finished processing BAM request
2018-11-29 14:23:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666324   8 58451 51796029 A  ERROR'
2018-11-29 14:23:16 [DEBUG   ] Got command BAM from MCS: ref #666323
2018-11-29 14:23:16 [INFO    ] Finished processing BAM request
2018-11-29 14:23:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 14:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   666323   8 58451 51796033 A  ERROR'
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 14:23:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 14:23:16 [DEBUG   ] spawn_process: at 2018-11-29 14:23:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 14:23:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 14:23:28 [DEBUG   ] Got command STP from MCS: ref #666326
2018-11-29 14:23:28 [INFO    ] Finished processing BAM request
2018-11-29 14:23:28 [INFO    ] Shutdown the adder chain on beam #2
2018-11-29 14:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   666326   8 58451 51808029 A  ERROR'
2018-11-29 14:23:28 [DEBUG   ] Got command STP from MCS: ref #666325
2018-11-29 14:23:28 [INFO    ] Finished processing BAM request
2018-11-29 14:23:28 [INFO    ] Shutdown the adder chain on beam #3
2018-11-29 14:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   666325   8 58451 51808033 A  ERROR'
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 14:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 14:23:28 [DEBUG   ] spawn_process: at 2018-11-29 14:23:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 14:23:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 14:23:54 [DEBUG   ] Got command RPT from MCS: ref #666329
2018-11-29 14:23:54 [DEBUG   ] summary = ERROR
2018-11-29 14:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666329  13 58451 51834981 A  ERRORERROR'
2018-11-29 14:23:55 [DEBUG   ] Got command RPT from MCS: ref #666330
2018-11-29 14:23:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666330  77 58451 51835185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:23:55 [DEBUG   ] Got command RPT from MCS: ref #666331
2018-11-29 14:23:55 [DEBUG   ] summary = ERROR
2018-11-29 14:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666331  13 58451 51835377 A  ERRORERROR'
2018-11-29 14:23:55 [DEBUG   ] Got command RPT from MCS: ref #666333
2018-11-29 14:23:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666333  77 58451 51835581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:23:55 [DEBUG   ] Got command RPT from MCS: ref #666334
2018-11-29 14:23:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666334  12 58451 51835785 A  ERRORB£ff'
2018-11-29 14:23:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 14:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 14:24:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:24:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:24:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:24:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:24:02 [DEBUG   ] Finished updating board flags in 1.295 seconds
2018-11-29 14:24:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 14:24:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 14:24:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 14:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:25:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:25:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:25:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:25:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:25:02 [DEBUG   ] Finished updating board flags in 1.165 seconds
2018-11-29 14:25:18 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-29 14:25:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:25:49 [DEBUG   ] Got command RPT from MCS: ref #666339
2018-11-29 14:25:49 [DEBUG   ] summary = ERROR
2018-11-29 14:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666339  13 58451 51949709 A  ERRORERROR'
2018-11-29 14:25:49 [DEBUG   ] Got command RPT from MCS: ref #666340
2018-11-29 14:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666340  77 58451 51949710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:25:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 14:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 14:26:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:26:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:26:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:26:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:26:02 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-29 14:26:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:26:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:26:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:27:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:27:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:27:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:27:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:27:02 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-29 14:27:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:27:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:27:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:28:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:28:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:28:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:28:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:28:02 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-11-29 14:28:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:28:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:28:55 [DEBUG   ] Got command RPT from MCS: ref #666360
2018-11-29 14:28:55 [DEBUG   ] summary = ERROR
2018-11-29 14:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666360  13 58451 52135061 A  ERRORERROR'
2018-11-29 14:28:55 [DEBUG   ] Got command RPT from MCS: ref #666361
2018-11-29 14:28:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666361  77 58451 52135265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:28:55 [DEBUG   ] Got command RPT from MCS: ref #666362
2018-11-29 14:28:55 [DEBUG   ] summary = ERROR
2018-11-29 14:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666362  13 58451 52135469 A  ERRORERROR'
2018-11-29 14:28:55 [DEBUG   ] Got command RPT from MCS: ref #666363
2018-11-29 14:28:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666363  77 58451 52135673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:28:55 [DEBUG   ] Got command RPT from MCS: ref #666364
2018-11-29 14:28:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:28:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666364  12 58451 52135865 A  ERRORB™™š'
2018-11-29 14:28:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:29:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:29:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:29:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:29:02 [WARNING ] (13, 1, 'bot')
2018-11-29 14:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:29:02 [DEBUG   ] Finished updating board flags in 0.923 seconds
2018-11-29 14:29:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:29:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:29:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:30:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:30:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:30:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:30:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:30:03 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-11-29 14:30:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 14:30:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:30:49 [DEBUG   ] Got command RPT from MCS: ref #666369
2018-11-29 14:30:49 [DEBUG   ] summary = ERROR
2018-11-29 14:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666369  13 58451 52249701 A  ERRORERROR'
2018-11-29 14:30:49 [DEBUG   ] Got command RPT from MCS: ref #666370
2018-11-29 14:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666370  77 58451 52249702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:30:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:31:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:31:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:31:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:31:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:31:03 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-29 14:31:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:31:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:31:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:32:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:32:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:32:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:32:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:32:03 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-29 14:32:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:32:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:32:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:33:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:33:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:33:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:33:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:33:03 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-29 14:33:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:33:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:33:55 [DEBUG   ] Got command RPT from MCS: ref #666392
2018-11-29 14:33:55 [DEBUG   ] summary = ERROR
2018-11-29 14:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666392  13 58451 52435157 A  ERRORERROR'
2018-11-29 14:33:55 [DEBUG   ] Got command RPT from MCS: ref #666393
2018-11-29 14:33:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666393  77 58451 52435349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:33:55 [DEBUG   ] Got command RPT from MCS: ref #666394
2018-11-29 14:33:55 [DEBUG   ] summary = ERROR
2018-11-29 14:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666394  13 58451 52435553 A  ERRORERROR'
2018-11-29 14:33:55 [DEBUG   ] Got command RPT from MCS: ref #666396
2018-11-29 14:33:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666396  77 58451 52435757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:33:55 [DEBUG   ] Got command RPT from MCS: ref #666397
2018-11-29 14:33:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666397  12 58451 52435949 A  ERRORB™™š'
2018-11-29 14:33:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:34:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:34:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:34:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:34:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:34:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:34:03 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-29 14:34:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:34:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:34:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:35:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:35:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:35:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:35:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:35:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:35:03 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-11-29 14:35:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:35:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:35:49 [DEBUG   ] Got command RPT from MCS: ref #666406
2018-11-29 14:35:49 [DEBUG   ] summary = ERROR
2018-11-29 14:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666406  13 58451 52549709 A  ERRORERROR'
2018-11-29 14:35:49 [DEBUG   ] Got command RPT from MCS: ref #666407
2018-11-29 14:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666407  77 58451 52549710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:35:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:36:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:36:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:36:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:36:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:36:04 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-29 14:36:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:36:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:36:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:37:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:37:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:37:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:37:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:37:04 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-29 14:37:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:37:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:37:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:38:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:38:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:38:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:38:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:38:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:38:03 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-29 14:38:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:38:38 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-29 14:38:55 [DEBUG   ] Got command RPT from MCS: ref #666427
2018-11-29 14:38:55 [DEBUG   ] summary = ERROR
2018-11-29 14:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666427  13 58451 52735241 A  ERRORERROR'
2018-11-29 14:38:55 [DEBUG   ] Got command RPT from MCS: ref #666428
2018-11-29 14:38:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666428  77 58451 52735433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:38:55 [DEBUG   ] Got command RPT from MCS: ref #666429
2018-11-29 14:38:55 [DEBUG   ] summary = ERROR
2018-11-29 14:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666429  13 58451 52735637 A  ERRORERROR'
2018-11-29 14:38:55 [DEBUG   ] Got command RPT from MCS: ref #666430
2018-11-29 14:38:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666430  77 58451 52735841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:38:56 [DEBUG   ] Got command RPT from MCS: ref #666431
2018-11-29 14:38:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666431  12 58451 52736045 A  ERRORB˜™š'
2018-11-29 14:38:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 14:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:39:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:39:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:39:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:39:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:39:03 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-29 14:39:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 14:39:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 14:39:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 14:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:40:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:40:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:40:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:40:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:40:03 [DEBUG   ] Finished updating board flags in 1.166 seconds
2018-11-29 14:40:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 14:40:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 14:40:49 [DEBUG   ] Got command RPT from MCS: ref #666432
2018-11-29 14:40:49 [DEBUG   ] summary = ERROR
2018-11-29 14:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666432  13 58451 52849705 A  ERRORERROR'
2018-11-29 14:40:49 [DEBUG   ] Got command RPT from MCS: ref #666433
2018-11-29 14:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666433  77 58451 52849706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:40:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 14:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:41:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:41:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:41:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:41:03 [WARNING ] (13, 1, 'bot')
2018-11-29 14:41:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:41:03 [DEBUG   ] Finished updating board flags in 1.026 seconds
2018-11-29 14:41:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 14:41:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 14:41:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 14:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:42:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:42:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:42:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:42:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:42:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:42:04 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-11-29 14:42:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 14:42:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 14:42:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 14:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:43:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:43:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:43:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:43:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:43:04 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-29 14:43:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 14:43:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 14:43:55 [DEBUG   ] Got command RPT from MCS: ref #666455
2018-11-29 14:43:55 [DEBUG   ] summary = ERROR
2018-11-29 14:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666455  13 58451 53035321 A  ERRORERROR'
2018-11-29 14:43:55 [DEBUG   ] Got command RPT from MCS: ref #666456
2018-11-29 14:43:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666456  77 58451 53035525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:43:55 [DEBUG   ] Got command RPT from MCS: ref #666457
2018-11-29 14:43:55 [DEBUG   ] summary = ERROR
2018-11-29 14:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666457  13 58451 53035729 A  ERRORERROR'
2018-11-29 14:43:55 [DEBUG   ] Got command RPT from MCS: ref #666459
2018-11-29 14:43:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666459  77 58451 53035921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:43:56 [DEBUG   ] Got command RPT from MCS: ref #666460
2018-11-29 14:43:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666460  12 58451 53036125 A  ERRORB™™š'
2018-11-29 14:43:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 14:44:00 [DEBUG   ] Got command TBN from MCS: ref #666465
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-29 14:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   666465   8 58451 53040810 A  ERROR'
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543502642']
2018-11-29 14:44:00 [DEBUG   ] spawn_process: at 2018-11-29 14:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543502642']
2018-11-29 14:44:00 [INFO    ] Finished spawning TBN in 0.050 s
2018-11-29 14:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:44:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:44:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:44:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:44:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:44:04 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-29 14:44:18 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2018-11-29 14:44:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-29 14:44:59 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-11-29 14:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 14:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:45:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:45:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:45:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:45:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:45:04 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-29 14:45:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-29 14:45:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 14:45:49 [DEBUG   ] Got command RPT from MCS: ref #666470
2018-11-29 14:45:49 [DEBUG   ] summary = ERROR
2018-11-29 14:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666470  13 58451 53149709 A  ERRORERROR'
2018-11-29 14:45:49 [DEBUG   ] Got command RPT from MCS: ref #666471
2018-11-29 14:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666471  77 58451 53149710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:45:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 14:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:46:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:46:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:46:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:46:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:46:04 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-29 14:46:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:46:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 14:46:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 14:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:47:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:47:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:47:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:47:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:47:04 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-11-29 14:47:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 14:47:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:47:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-29 14:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:48:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:48:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:48:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:48:04 [WARNING ] (13, 1, 'bot')
2018-11-29 14:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:48:04 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-11-29 14:48:11 [DEBUG   ] Got command TBW from MCS: ref #666492
2018-11-29 14:48:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-29 14:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   666492   8 58451 53291882 A  ERROR'
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-29 14:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-29 14:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-29 14:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-29 14:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-29 14:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-29 14:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-29 14:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-29 14:48:15 [DEBUG   ] spawn_process: at 2018-11-29 14:48:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-29 14:48:15 [INFO    ] Finished spawning TBW
2018-11-29 14:48:55 [DEBUG   ] Got command RPT from MCS: ref #666495
2018-11-29 14:48:55 [DEBUG   ] summary = ERROR
2018-11-29 14:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666495  13 58451 53335405 A  ERRORERROR'
2018-11-29 14:48:55 [DEBUG   ] Got command RPT from MCS: ref #666496
2018-11-29 14:48:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666496  77 58451 53335609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:48:55 [DEBUG   ] Got command RPT from MCS: ref #666497
2018-11-29 14:48:55 [DEBUG   ] summary = ERROR
2018-11-29 14:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666497  13 58451 53335813 A  ERRORERROR'
2018-11-29 14:48:56 [DEBUG   ] Got command RPT from MCS: ref #666498
2018-11-29 14:48:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666498  77 58451 53336017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:48:56 [DEBUG   ] Got command RPT from MCS: ref #666499
2018-11-29 14:48:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666499  12 58451 53336209 A  ERRORB˜™š'
2018-11-29 14:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:49:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:49:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:49:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:49:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:49:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:49:05 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-11-29 14:50:03 [INFO    ] __waitForTBW - TBW finished in 108.441 s
2018-11-29 14:50:04 [DEBUG   ] Finished updating ant stats in 0.481 seconds
2018-11-29 14:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:50:04 [INFO    ] Started antennas statistics background thread
2018-11-29 14:50:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543503006']
2018-11-29 14:50:04 [DEBUG   ] spawn_process: at 2018-11-29 14:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543503006']
2018-11-29 14:50:04 [INFO    ] Finished spawning TBN in 0.051 s
2018-11-29 14:50:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:50:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:50:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:50:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:50:05 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-11-29 14:50:24 [DEBUG   ] Finished updating ant stats in 0.438 seconds
2018-11-29 14:50:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 14:50:49 [DEBUG   ] Got command RPT from MCS: ref #666509
2018-11-29 14:50:49 [DEBUG   ] summary = ERROR
2018-11-29 14:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666509  13 58451 53449713 A  ERRORERROR'
2018-11-29 14:50:49 [DEBUG   ] Got command RPT from MCS: ref #666510
2018-11-29 14:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666510  77 58451 53449714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:51:04 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2018-11-29 14:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:51:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:51:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:51:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:51:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:51:05 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-29 14:51:25 [DEBUG   ] Finished updating ant stats in 1.350 seconds
2018-11-29 14:51:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 14:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:52:05 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2018-11-29 14:52:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:52:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:52:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:52:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:52:05 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-11-29 14:52:25 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-11-29 14:52:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 14:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:53:05 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-11-29 14:53:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:53:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:53:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:53:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:53:05 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-11-29 14:53:25 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-11-29 14:53:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 14:53:55 [DEBUG   ] Got command RPT from MCS: ref #666532
2018-11-29 14:53:55 [DEBUG   ] summary = ERROR
2018-11-29 14:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666532  13 58451 53635497 A  ERRORERROR'
2018-11-29 14:53:55 [DEBUG   ] Got command RPT from MCS: ref #666533
2018-11-29 14:53:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666533  77 58451 53635689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:53:55 [DEBUG   ] Got command RPT from MCS: ref #666534
2018-11-29 14:53:55 [DEBUG   ] summary = ERROR
2018-11-29 14:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666534  13 58451 53635893 A  ERRORERROR'
2018-11-29 14:53:56 [DEBUG   ] Got command RPT from MCS: ref #666536
2018-11-29 14:53:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666536  77 58451 53636097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:53:56 [DEBUG   ] Got command RPT from MCS: ref #666538
2018-11-29 14:53:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666538  12 58451 53636301 A  ERRORB—™š'
2018-11-29 14:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 14:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 14:54:05 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-11-29 14:54:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:54:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:54:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:54:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:54:05 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-29 14:54:25 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-11-29 14:54:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 14:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:55:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:55:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:55:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:55:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:55:05 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-11-29 14:55:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 14:55:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 14:55:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 14:55:49 [DEBUG   ] Got command RPT from MCS: ref #666542
2018-11-29 14:55:49 [DEBUG   ] summary = ERROR
2018-11-29 14:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666542  13 58451 53749709 A  ERRORERROR'
2018-11-29 14:55:49 [DEBUG   ] Got command RPT from MCS: ref #666543
2018-11-29 14:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666543  77 58451 53749710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:56:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:56:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:56:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:56:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:56:05 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-11-29 14:56:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 14:56:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:56:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 14:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 14:57:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:57:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:57:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:57:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:57:05 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-29 14:57:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 14:57:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 14:57:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 14:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:58:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:58:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:58:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:58:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:58:05 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-11-29 14:58:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 14:58:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-29 14:58:47 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-29 14:58:55 [DEBUG   ] Got command RPT from MCS: ref #666563
2018-11-29 14:58:55 [DEBUG   ] summary = ERROR
2018-11-29 14:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666563  13 58451 53935577 A  ERRORERROR'
2018-11-29 14:58:55 [DEBUG   ] Got command RPT from MCS: ref #666564
2018-11-29 14:58:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666564  77 58451 53935781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:58:55 [DEBUG   ] Got command RPT from MCS: ref #666565
2018-11-29 14:58:55 [DEBUG   ] summary = ERROR
2018-11-29 14:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666565  13 58451 53935985 A  ERRORERROR'
2018-11-29 14:58:56 [DEBUG   ] Got command RPT from MCS: ref #666566
2018-11-29 14:58:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 14:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666566  77 58451 53936189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 14:58:56 [DEBUG   ] Got command RPT from MCS: ref #666567
2018-11-29 14:58:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 14:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666567  12 58451 53936381 A  ERRORB˜™š'
2018-11-29 14:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 14:59:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:59:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:59:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:59:05 [WARNING ] (13, 1, 'bot')
2018-11-29 14:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 14:59:05 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-11-29 14:59:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 14:59:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 14:59:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-29 15:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:00:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:00:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:00:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:00:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:00:05 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-29 15:00:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:00:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:00:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:00:49 [DEBUG   ] Got command RPT from MCS: ref #666572
2018-11-29 15:00:49 [DEBUG   ] summary = ERROR
2018-11-29 15:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666572  13 58451 54049709 A  ERRORERROR'
2018-11-29 15:00:49 [DEBUG   ] Got command RPT from MCS: ref #666573
2018-11-29 15:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666573  77 58451 54049710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:01:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:01:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:01:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:01:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:01:05 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-29 15:01:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:01:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:01:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:02:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:02:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:02:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:02:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:02:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:02:05 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-29 15:02:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 15:02:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 15:02:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:03:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:03:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:03:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:03:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:03:05 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-29 15:03:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:03:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 15:03:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 15:03:55 [DEBUG   ] Got command RPT from MCS: ref #666595
2018-11-29 15:03:55 [DEBUG   ] summary = ERROR
2018-11-29 15:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666595  13 58451 54235673 A  ERRORERROR'
2018-11-29 15:03:55 [DEBUG   ] Got command RPT from MCS: ref #666596
2018-11-29 15:03:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666596  77 58451 54235865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:03:56 [DEBUG   ] Got command RPT from MCS: ref #666597
2018-11-29 15:03:56 [DEBUG   ] summary = ERROR
2018-11-29 15:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666597  13 58451 54236069 A  ERRORERROR'
2018-11-29 15:03:56 [DEBUG   ] Got command RPT from MCS: ref #666599
2018-11-29 15:03:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666599  77 58451 54236273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:03:56 [DEBUG   ] Got command RPT from MCS: ref #666600
2018-11-29 15:03:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666600  12 58451 54236477 A  ERRORB˜™š'
2018-11-29 15:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:04:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:04:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:04:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:04:05 [WARNING ] (13, 1, 'bot')
2018-11-29 15:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:04:05 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-11-29 15:04:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-29 15:04:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 15:04:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:05:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:05:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:05:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:05:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:05:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:05:06 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-11-29 15:05:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:05:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:05:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:05:49 [DEBUG   ] Got command RPT from MCS: ref #666609
2018-11-29 15:05:49 [DEBUG   ] summary = ERROR
2018-11-29 15:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666609  13 58451 54349713 A  ERRORERROR'
2018-11-29 15:05:49 [DEBUG   ] Got command RPT from MCS: ref #666610
2018-11-29 15:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666610  77 58451 54349714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:06:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:06:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:06:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:06:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:06:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:06:06 [DEBUG   ] Finished updating board flags in 2.246 seconds
2018-11-29 15:06:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:06:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 15:06:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:07:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:07:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:07:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:07:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:07:06 [DEBUG   ] Finished updating board flags in 2.142 seconds
2018-11-29 15:07:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 15:07:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:07:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:08:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:08:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:08:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:08:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:08:06 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-29 15:08:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:08:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 15:08:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 15:08:55 [DEBUG   ] Got command RPT from MCS: ref #666630
2018-11-29 15:08:55 [DEBUG   ] summary = ERROR
2018-11-29 15:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666630  13 58451 54535757 A  ERRORERROR'
2018-11-29 15:08:55 [DEBUG   ] Got command RPT from MCS: ref #666631
2018-11-29 15:08:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666631  77 58451 54535949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:08:56 [DEBUG   ] Got command RPT from MCS: ref #666632
2018-11-29 15:08:56 [DEBUG   ] summary = ERROR
2018-11-29 15:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666632  13 58451 54536153 A  ERRORERROR'
2018-11-29 15:08:56 [DEBUG   ] Got command RPT from MCS: ref #666633
2018-11-29 15:08:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666633  77 58451 54536357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:08:56 [DEBUG   ] Got command RPT from MCS: ref #666634
2018-11-29 15:08:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666634  12 58451 54536549 A  ERRORB˜™š'
2018-11-29 15:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:09:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:09:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:09:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:09:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:09:06 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-11-29 15:09:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-29 15:09:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 15:09:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 15:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:10:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:10:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:10:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:10:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:10:06 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-29 15:10:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 15:10:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:10:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:10:49 [DEBUG   ] Got command RPT from MCS: ref #666635
2018-11-29 15:10:49 [DEBUG   ] summary = ERROR
2018-11-29 15:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666635  13 58451 54649721 A  ERRORERROR'
2018-11-29 15:10:49 [DEBUG   ] Got command RPT from MCS: ref #666636
2018-11-29 15:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666636  77 58451 54649722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:11:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:11:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:11:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:11:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:11:06 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-11-29 15:11:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:11:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:11:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:12:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:12:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:12:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:12:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:12:06 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-11-29 15:12:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:12:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:12:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:13:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:13:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:13:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:13:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:13:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:13:06 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-29 15:13:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:13:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 15:13:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 15:13:55 [DEBUG   ] Got command RPT from MCS: ref #666658
2018-11-29 15:13:55 [DEBUG   ] summary = ERROR
2018-11-29 15:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666658  13 58451 54835841 A  ERRORERROR'
2018-11-29 15:13:56 [DEBUG   ] Got command RPT from MCS: ref #666659
2018-11-29 15:13:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666659  77 58451 54836045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:13:56 [DEBUG   ] Got command RPT from MCS: ref #666660
2018-11-29 15:13:56 [DEBUG   ] summary = ERROR
2018-11-29 15:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666660  13 58451 54836237 A  ERRORERROR'
2018-11-29 15:13:56 [DEBUG   ] Got command RPT from MCS: ref #666662
2018-11-29 15:13:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666662  77 58451 54836441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:13:56 [DEBUG   ] Got command RPT from MCS: ref #666663
2018-11-29 15:13:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666663  12 58451 54836645 A  ERRORB™™š'
2018-11-29 15:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:14:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:14:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:14:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:14:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:14:06 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-29 15:14:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:14:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:14:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:15:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:15:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:15:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:15:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:15:06 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-11-29 15:15:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 15:15:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 15:15:49 [DEBUG   ] Got command RPT from MCS: ref #666672
2018-11-29 15:15:49 [DEBUG   ] summary = ERROR
2018-11-29 15:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666672  13 58451 54949721 A  ERRORERROR'
2018-11-29 15:15:49 [DEBUG   ] Got command RPT from MCS: ref #666673
2018-11-29 15:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666673  77 58451 54949722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:15:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 15:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:16:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:16:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:16:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:16:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:16:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-29 15:16:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 15:16:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 15:16:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-29 15:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:17:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:17:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:17:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:17:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:17:06 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-29 15:17:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 15:17:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:17:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:18:06 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-29 15:18:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 15:18:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 15:18:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:18:55 [DEBUG   ] Got command RPT from MCS: ref #666693
2018-11-29 15:18:55 [DEBUG   ] summary = ERROR
2018-11-29 15:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666693  13 58451 55135925 A  ERRORERROR'
2018-11-29 15:18:56 [DEBUG   ] Got command RPT from MCS: ref #666694
2018-11-29 15:18:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666694  77 58451 55136129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:18:56 [DEBUG   ] Got command RPT from MCS: ref #666695
2018-11-29 15:18:56 [DEBUG   ] summary = ERROR
2018-11-29 15:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666695  13 58451 55136333 A  ERRORERROR'
2018-11-29 15:18:56 [DEBUG   ] Got command RPT from MCS: ref #666696
2018-11-29 15:18:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666696  77 58451 55136525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:18:56 [DEBUG   ] Got command RPT from MCS: ref #666697
2018-11-29 15:18:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666697  12 58451 55136729 A  ERRORB˜™š'
2018-11-29 15:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:19:06 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-29 15:19:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 15:19:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:19:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 15:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:20:06 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-11-29 15:20:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:20:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:20:49 [DEBUG   ] Got command RPT from MCS: ref #666702
2018-11-29 15:20:49 [DEBUG   ] summary = ERROR
2018-11-29 15:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666702  13 58451 55249726 A  ERRORERROR'
2018-11-29 15:20:49 [DEBUG   ] Got command RPT from MCS: ref #666703
2018-11-29 15:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666703  77 58451 55249726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:20:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-29 15:21:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:21:06 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-11-29 15:21:10 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-29 15:21:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 15:21:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 15:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:22:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:22:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:22:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:22:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:22:07 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-11-29 15:22:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 15:22:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 15:22:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 15:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:23:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:23:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:23:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:23:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:23:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:23:07 [DEBUG   ] Finished updating board flags in 2.145 seconds
2018-11-29 15:23:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 15:23:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:23:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:23:56 [DEBUG   ] Got command RPT from MCS: ref #666725
2018-11-29 15:23:56 [DEBUG   ] summary = ERROR
2018-11-29 15:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666725  13 58451 55436013 A  ERRORERROR'
2018-11-29 15:23:56 [DEBUG   ] Got command RPT from MCS: ref #666726
2018-11-29 15:23:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666726  77 58451 55436205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:23:56 [DEBUG   ] Got command RPT from MCS: ref #666727
2018-11-29 15:23:56 [DEBUG   ] summary = ERROR
2018-11-29 15:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666727  13 58451 55436409 A  ERRORERROR'
2018-11-29 15:23:56 [DEBUG   ] Got command RPT from MCS: ref #666729
2018-11-29 15:23:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666729  77 58451 55436613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:23:56 [DEBUG   ] Got command RPT from MCS: ref #666730
2018-11-29 15:23:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666730  12 58451 55436817 A  ERRORB™™š'
2018-11-29 15:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 15:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 15:24:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:24:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:24:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:24:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:24:07 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-11-29 15:24:11 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2018-11-29 15:24:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 15:24:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 15:25:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 15:25:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:25:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:25:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:25:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:25:07 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-11-29 15:25:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:25:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:25:49 [DEBUG   ] Got command RPT from MCS: ref #666735
2018-11-29 15:25:49 [DEBUG   ] summary = ERROR
2018-11-29 15:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666735  13 58451 55549721 A  ERRORERROR'
2018-11-29 15:25:49 [DEBUG   ] Got command RPT from MCS: ref #666736
2018-11-29 15:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666736  77 58451 55549722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:25:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 15:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:26:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:26:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:26:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:26:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:26:07 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-29 15:26:12 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-29 15:26:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 15:26:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 15:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:27:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:27:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:27:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:27:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:27:07 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-11-29 15:27:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-29 15:27:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 15:27:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 15:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:28:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:28:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:28:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:28:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:28:07 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-29 15:28:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 15:28:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:28:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:28:56 [DEBUG   ] Got command RPT from MCS: ref #666756
2018-11-29 15:28:56 [DEBUG   ] summary = ERROR
2018-11-29 15:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666756  13 58451 55736089 A  ERRORERROR'
2018-11-29 15:28:56 [DEBUG   ] Got command RPT from MCS: ref #666757
2018-11-29 15:28:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666757  77 58451 55736293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:28:56 [DEBUG   ] Got command RPT from MCS: ref #666758
2018-11-29 15:28:56 [DEBUG   ] summary = ERROR
2018-11-29 15:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666758  13 58451 55736497 A  ERRORERROR'
2018-11-29 15:28:56 [DEBUG   ] Got command RPT from MCS: ref #666759
2018-11-29 15:28:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666759  77 58451 55736701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:28:56 [DEBUG   ] Got command RPT from MCS: ref #666760
2018-11-29 15:28:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666760  12 58451 55736894 A  ERRORB™™š'
2018-11-29 15:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:29:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:29:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:29:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:29:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:29:07 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-29 15:29:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:29:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:29:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:30:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:30:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:30:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:30:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:30:07 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-29 15:30:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 15:30:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:30:49 [DEBUG   ] Got command RPT from MCS: ref #666765
2018-11-29 15:30:49 [DEBUG   ] summary = ERROR
2018-11-29 15:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666765  13 58451 55849717 A  ERRORERROR'
2018-11-29 15:30:49 [DEBUG   ] Got command RPT from MCS: ref #666766
2018-11-29 15:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666766  77 58451 55849718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:30:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 15:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:31:07 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-29 15:31:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:31:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:31:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:32:07 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-29 15:32:12 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-29 15:32:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-29 15:32:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-29 15:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-29 15:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:33:07 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-29 15:33:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 15:33:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:33:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:33:56 [DEBUG   ] Got command RPT from MCS: ref #666788
2018-11-29 15:33:56 [DEBUG   ] summary = ERROR
2018-11-29 15:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666788  13 58451 56036181 A  ERRORERROR'
2018-11-29 15:33:56 [DEBUG   ] Got command RPT from MCS: ref #666789
2018-11-29 15:33:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666789  77 58451 56036385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:33:56 [DEBUG   ] Got command RPT from MCS: ref #666790
2018-11-29 15:33:56 [DEBUG   ] summary = ERROR
2018-11-29 15:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666790  13 58451 56036577 A  ERRORERROR'
2018-11-29 15:33:56 [DEBUG   ] Got command RPT from MCS: ref #666792
2018-11-29 15:33:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666792  77 58451 56036781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:33:56 [DEBUG   ] Got command RPT from MCS: ref #666794
2018-11-29 15:33:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666794  12 58451 56036985 A  ERRORB˜™š'
2018-11-29 15:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:34:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:34:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:34:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:34:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:34:08 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-11-29 15:34:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:34:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:34:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:35:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:35:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:35:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:35:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:35:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:35:08 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-11-29 15:35:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:35:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:35:49 [DEBUG   ] Got command RPT from MCS: ref #666802
2018-11-29 15:35:49 [DEBUG   ] summary = ERROR
2018-11-29 15:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666802  13 58451 56149717 A  ERRORERROR'
2018-11-29 15:35:49 [DEBUG   ] Got command RPT from MCS: ref #666803
2018-11-29 15:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666803  77 58451 56149718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:35:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 15:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:36:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:36:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:36:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:36:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:36:08 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-29 15:36:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:36:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:36:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:37:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2018-11-29 15:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:37:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:37:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:37:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:37:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:37:08 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-29 15:37:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:37:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:37:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:38:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:38:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:38:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:38:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:38:08 [DEBUG   ] Finished updating board flags in 1.641 seconds
2018-11-29 15:38:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-29 15:38:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 15:38:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 15:38:56 [DEBUG   ] Got command RPT from MCS: ref #666823
2018-11-29 15:38:56 [DEBUG   ] summary = ERROR
2018-11-29 15:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666823  13 58451 56336261 A  ERRORERROR'
2018-11-29 15:38:56 [DEBUG   ] Got command RPT from MCS: ref #666824
2018-11-29 15:38:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666824  77 58451 56336465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:38:56 [DEBUG   ] Got command RPT from MCS: ref #666825
2018-11-29 15:38:56 [DEBUG   ] summary = ERROR
2018-11-29 15:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666825  13 58451 56336669 A  ERRORERROR'
2018-11-29 15:38:56 [DEBUG   ] Got command RPT from MCS: ref #666826
2018-11-29 15:38:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:38:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666826  77 58451 56336873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:38:57 [DEBUG   ] Got command RPT from MCS: ref #666827
2018-11-29 15:38:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666827  12 58451 56337065 A  ERRORB™™š'
2018-11-29 15:39:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:39:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:39:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:39:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:39:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:39:08 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-11-29 15:39:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 15:39:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 15:39:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:40:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:40:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:40:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:40:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:40:08 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-29 15:40:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:40:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:40:49 [DEBUG   ] Got command RPT from MCS: ref #666828
2018-11-29 15:40:49 [DEBUG   ] summary = ERROR
2018-11-29 15:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666828  13 58451 56449725 A  ERRORERROR'
2018-11-29 15:40:49 [DEBUG   ] Got command RPT from MCS: ref #666829
2018-11-29 15:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666829  77 58451 56449726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:40:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-29 15:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:41:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:41:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:41:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:41:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:41:08 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-29 15:41:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:41:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:41:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:42:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:42:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:42:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:42:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:42:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:42:08 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-29 15:42:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 15:42:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-29 15:42:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 15:43:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:43:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:43:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:43:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:43:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:43:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:43:09 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-11-29 15:43:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 15:43:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 15:43:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-29 15:43:56 [DEBUG   ] Got command RPT from MCS: ref #666851
2018-11-29 15:43:56 [DEBUG   ] summary = ERROR
2018-11-29 15:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666851  13 58451 56636349 A  ERRORERROR'
2018-11-29 15:43:56 [DEBUG   ] Got command RPT from MCS: ref #666852
2018-11-29 15:43:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666852  77 58451 56636553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:43:56 [DEBUG   ] Got command RPT from MCS: ref #666853
2018-11-29 15:43:56 [DEBUG   ] summary = ERROR
2018-11-29 15:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666853  13 58451 56636745 A  ERRORERROR'
2018-11-29 15:43:56 [DEBUG   ] Got command RPT from MCS: ref #666854
2018-11-29 15:43:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666854  77 58451 56636949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:43:57 [DEBUG   ] Got command RPT from MCS: ref #666856
2018-11-29 15:43:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666856  12 58451 56637153 A  ERRORB™™š'
2018-11-29 15:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:44:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:44:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:44:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:44:08 [WARNING ] (13, 1, 'bot')
2018-11-29 15:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:44:08 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-29 15:44:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 15:44:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:44:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:45:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:45:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:45:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:45:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:45:09 [DEBUG   ] Finished updating board flags in 2.075 seconds
2018-11-29 15:45:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-29 15:45:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:45:49 [DEBUG   ] Got command RPT from MCS: ref #666865
2018-11-29 15:45:49 [DEBUG   ] summary = ERROR
2018-11-29 15:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666865  13 58451 56749725 A  ERRORERROR'
2018-11-29 15:45:49 [DEBUG   ] Got command RPT from MCS: ref #666866
2018-11-29 15:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666866  77 58451 56749726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:45:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:46:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:46:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:46:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:46:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:46:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:46:09 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-11-29 15:46:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 15:46:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:46:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 15:47:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:47:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:47:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:47:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:47:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:47:09 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-11-29 15:47:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 15:47:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:47:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-29 15:48:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:48:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:48:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:48:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:48:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:48:09 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-11-29 15:48:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 15:48:36 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-29 15:48:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-29 15:48:56 [DEBUG   ] Got command RPT from MCS: ref #666886
2018-11-29 15:48:56 [DEBUG   ] summary = ERROR
2018-11-29 15:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666886  13 58451 56936441 A  ERRORERROR'
2018-11-29 15:48:56 [DEBUG   ] Got command RPT from MCS: ref #666887
2018-11-29 15:48:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666887  77 58451 56936633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:48:56 [DEBUG   ] Got command RPT from MCS: ref #666888
2018-11-29 15:48:56 [DEBUG   ] summary = ERROR
2018-11-29 15:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666888  13 58451 56936837 A  ERRORERROR'
2018-11-29 15:48:57 [DEBUG   ] Got command RPT from MCS: ref #666889
2018-11-29 15:48:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666889  77 58451 56937041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:48:57 [DEBUG   ] Got command RPT from MCS: ref #666890
2018-11-29 15:48:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666890  12 58451 56937233 A  ERRORB˜™š'
2018-11-29 15:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 15:49:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:49:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:49:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:49:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:49:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:49:09 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-29 15:49:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 15:49:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:49:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:50:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:50:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:50:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:50:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:50:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:50:09 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-29 15:50:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:50:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:50:49 [DEBUG   ] Got command RPT from MCS: ref #666895
2018-11-29 15:50:49 [DEBUG   ] summary = ERROR
2018-11-29 15:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666895  13 58451 57049725 A  ERRORERROR'
2018-11-29 15:50:49 [DEBUG   ] Got command RPT from MCS: ref #666896
2018-11-29 15:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666896  77 58451 57049726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:50:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:51:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:51:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:51:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:51:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:51:09 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-29 15:51:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:51:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:51:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:52:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:52:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:52:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:52:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:52:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:52:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:52:09 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-29 15:52:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:52:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 15:52:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 15:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:53:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:53:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:53:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:53:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:53:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:53:09 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-29 15:53:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 15:53:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:53:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:53:56 [DEBUG   ] Got command RPT from MCS: ref #666918
2018-11-29 15:53:56 [DEBUG   ] summary = ERROR
2018-11-29 15:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666918  13 58451 57236513 A  ERRORERROR'
2018-11-29 15:53:56 [DEBUG   ] Got command RPT from MCS: ref #666919
2018-11-29 15:53:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666919  77 58451 57236721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:53:56 [DEBUG   ] Got command RPT from MCS: ref #666920
2018-11-29 15:53:56 [DEBUG   ] summary = ERROR
2018-11-29 15:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666920  13 58451 57236921 A  ERRORERROR'
2018-11-29 15:53:57 [DEBUG   ] Got command RPT from MCS: ref #666922
2018-11-29 15:53:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666922  77 58451 57237125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:53:57 [DEBUG   ] Got command RPT from MCS: ref #666924
2018-11-29 15:53:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666924  12 58451 57237317 A  ERRORB™™š'
2018-11-29 15:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 15:54:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:54:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:54:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:54:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:54:09 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-11-29 15:54:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 15:54:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 15:54:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 15:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:55:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 15:55:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:55:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:55:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:55:09 [WARNING ] (13, 1, 'bot')
2018-11-29 15:55:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:55:09 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-29 15:55:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 15:55:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 15:55:49 [DEBUG   ] Got command RPT from MCS: ref #666928
2018-11-29 15:55:49 [DEBUG   ] summary = ERROR
2018-11-29 15:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666928  13 58451 57349733 A  ERRORERROR'
2018-11-29 15:55:49 [DEBUG   ] Got command RPT from MCS: ref #666929
2018-11-29 15:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666929  77 58451 57349734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:55:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 15:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 15:56:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:56:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:56:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:56:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:56:10 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-11-29 15:56:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 15:56:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 15:56:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 15:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:57:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:57:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:57:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:57:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:57:10 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-11-29 15:57:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:57:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:57:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:58:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:58:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:58:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:58:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:58:10 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-29 15:58:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:58:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 15:58:56 [DEBUG   ] Got command RPT from MCS: ref #666949
2018-11-29 15:58:56 [DEBUG   ] summary = ERROR
2018-11-29 15:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666949  13 58451 57536609 A  ERRORERROR'
2018-11-29 15:58:56 [DEBUG   ] Got command RPT from MCS: ref #666950
2018-11-29 15:58:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666950  77 58451 57536801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:58:57 [DEBUG   ] Got command RPT from MCS: ref #666951
2018-11-29 15:58:57 [DEBUG   ] summary = ERROR
2018-11-29 15:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666951  13 58451 57537005 A  ERRORERROR'
2018-11-29 15:58:57 [DEBUG   ] Got command RPT from MCS: ref #666952
2018-11-29 15:58:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 15:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666952  77 58451 57537209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 15:58:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 15:58:57 [DEBUG   ] Got command RPT from MCS: ref #666953
2018-11-29 15:58:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 15:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666953  12 58451 57537413 A  ERRORB™™š'
2018-11-29 15:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 15:59:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 15:59:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:59:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:59:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:59:10 [WARNING ] (13, 1, 'bot')
2018-11-29 15:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 15:59:10 [DEBUG   ] Finished updating board flags in 2.103 seconds
2018-11-29 15:59:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 15:59:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 15:59:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 16:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:00:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:00:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:00:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:00:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:00:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:00:10 [DEBUG   ] Finished updating board flags in 1.897 seconds
2018-11-29 16:00:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 16:00:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:00:49 [DEBUG   ] Got command RPT from MCS: ref #666958
2018-11-29 16:00:49 [DEBUG   ] summary = ERROR
2018-11-29 16:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666958  13 58451 57649725 A  ERRORERROR'
2018-11-29 16:00:49 [DEBUG   ] Got command RPT from MCS: ref #666959
2018-11-29 16:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666959  77 58451 57649726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:00:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 16:01:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:01:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:01:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:01:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:01:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:01:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:01:10 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-29 16:01:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:01:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:01:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:02:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:02:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:02:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:02:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:02:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:02:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:02:10 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-29 16:02:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 16:02:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:02:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:03:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:03:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:03:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:03:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:03:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:03:10 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-29 16:03:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:03:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 16:03:56 [DEBUG   ] Got command RPT from MCS: ref #666981
2018-11-29 16:03:56 [DEBUG   ] summary = ERROR
2018-11-29 16:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666981  13 58451 57836693 A  ERRORERROR'
2018-11-29 16:03:56 [DEBUG   ] Got command RPT from MCS: ref #666982
2018-11-29 16:03:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666982  77 58451 57836897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:03:57 [DEBUG   ] Got command RPT from MCS: ref #666983
2018-11-29 16:03:57 [DEBUG   ] summary = ERROR
2018-11-29 16:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666983  13 58451 57837089 A  ERRORERROR'
2018-11-29 16:03:57 [DEBUG   ] Got command RPT from MCS: ref #666985
2018-11-29 16:03:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666985  77 58451 57837293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:03:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 16:03:57 [DEBUG   ] Got command RPT from MCS: ref #666987
2018-11-29 16:03:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666987  12 58451 57837497 A  ERRORB˜™š'
2018-11-29 16:04:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:04:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:04:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:04:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:04:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:04:10 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-11-29 16:04:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-29 16:04:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-29 16:04:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 16:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:05:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:05:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:05:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:05:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:05:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:05:10 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-29 16:05:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 16:05:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 16:05:49 [DEBUG   ] Got command RPT from MCS: ref #666995
2018-11-29 16:05:49 [DEBUG   ] summary = ERROR
2018-11-29 16:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666995  13 58451 57949729 A  ERRORERROR'
2018-11-29 16:05:49 [DEBUG   ] Got command RPT from MCS: ref #666996
2018-11-29 16:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   666996  77 58451 57949730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:05:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 16:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:06:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:06:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:06:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:06:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:06:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:06:10 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-29 16:06:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 16:06:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 16:06:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-29 16:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:07:10 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-11-29 16:07:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 16:07:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 16:07:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:08:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 16:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:08:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:08:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:08:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:08:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:08:11 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-11-29 16:08:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:08:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 16:08:56 [DEBUG   ] Got command RPT from MCS: ref #667016
2018-11-29 16:08:56 [DEBUG   ] summary = ERROR
2018-11-29 16:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667016  13 58451 58136781 A  ERRORERROR'
2018-11-29 16:08:56 [DEBUG   ] Got command RPT from MCS: ref #667017
2018-11-29 16:08:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667017  77 58451 58136973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:08:57 [DEBUG   ] Got command RPT from MCS: ref #667018
2018-11-29 16:08:57 [DEBUG   ] summary = ERROR
2018-11-29 16:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667018  13 58451 58137177 A  ERRORERROR'
2018-11-29 16:08:57 [DEBUG   ] Got command RPT from MCS: ref #667019
2018-11-29 16:08:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667019  77 58451 58137381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:08:57 [DEBUG   ] Got command RPT from MCS: ref #667020
2018-11-29 16:08:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667020  12 58451 58137585 A  ERRORB˜™š'
2018-11-29 16:08:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 16:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 16:09:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:09:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:09:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:09:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:09:11 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-11-29 16:09:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:09:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:09:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 16:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:10:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 16:10:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:10:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:10:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:10:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:10:11 [DEBUG   ] Finished updating board flags in 1.913 seconds
2018-11-29 16:10:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 16:10:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 16:10:49 [DEBUG   ] Got command RPT from MCS: ref #667021
2018-11-29 16:10:49 [DEBUG   ] summary = ERROR
2018-11-29 16:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667021  13 58451 58249729 A  ERRORERROR'
2018-11-29 16:10:49 [DEBUG   ] Got command RPT from MCS: ref #667022
2018-11-29 16:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667022  77 58451 58249730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:10:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 16:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:11:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:11:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:11:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:11:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:11:11 [DEBUG   ] Finished updating board flags in 1.705 seconds
2018-11-29 16:11:19 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-29 16:11:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-29 16:11:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 16:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:12:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 16:12:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:12:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:12:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:12:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:12:11 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-29 16:12:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:12:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:12:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 16:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:13:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:13:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:13:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:13:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:13:11 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-11-29 16:13:19 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-29 16:13:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:13:56 [DEBUG   ] Got command RPT from MCS: ref #667044
2018-11-29 16:13:56 [DEBUG   ] summary = ERROR
2018-11-29 16:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667044  13 58451 58436861 A  ERRORERROR'
2018-11-29 16:13:57 [DEBUG   ] Got command RPT from MCS: ref #667045
2018-11-29 16:13:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667045  77 58451 58437065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:13:57 [DEBUG   ] Got command RPT from MCS: ref #667046
2018-11-29 16:13:57 [DEBUG   ] summary = ERROR
2018-11-29 16:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667046  13 58451 58437269 A  ERRORERROR'
2018-11-29 16:13:57 [DEBUG   ] Got command RPT from MCS: ref #667048
2018-11-29 16:13:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667048  77 58451 58437473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:13:57 [DEBUG   ] Got command RPT from MCS: ref #667049
2018-11-29 16:13:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667049  12 58451 58437665 A  ERRORBš™š'
2018-11-29 16:13:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:14:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 16:14:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:14:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:14:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:14:11 [WARNING ] (13, 1, 'bot')
2018-11-29 16:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:14:11 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-11-29 16:14:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-29 16:14:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 16:14:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 16:15:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:15:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:15:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:15:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:15:12 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-11-29 16:15:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 16:15:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 16:15:49 [DEBUG   ] Got command RPT from MCS: ref #667058
2018-11-29 16:15:49 [DEBUG   ] summary = ERROR
2018-11-29 16:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667058  13 58451 58549737 A  ERRORERROR'
2018-11-29 16:15:49 [DEBUG   ] Got command RPT from MCS: ref #667059
2018-11-29 16:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667059  77 58451 58549738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:16:00 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-29 16:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:16:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 16:16:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:16:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:16:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:16:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:16:12 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-29 16:16:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 16:16:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 16:17:00 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 16:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:17:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:17:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:17:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:17:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:17:12 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-11-29 16:17:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:17:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:18:00 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-29 16:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:18:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:18:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:18:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:18:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:18:12 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-11-29 16:18:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 16:18:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:18:56 [DEBUG   ] Got command RPT from MCS: ref #667079
2018-11-29 16:18:56 [DEBUG   ] summary = ERROR
2018-11-29 16:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667079  13 58451 58736957 A  ERRORERROR'
2018-11-29 16:18:57 [DEBUG   ] Got command RPT from MCS: ref #667080
2018-11-29 16:18:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667080  77 58451 58737149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:18:57 [DEBUG   ] Got command RPT from MCS: ref #667081
2018-11-29 16:18:57 [DEBUG   ] summary = ERROR
2018-11-29 16:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667081  13 58451 58737353 A  ERRORERROR'
2018-11-29 16:18:57 [DEBUG   ] Got command RPT from MCS: ref #667082
2018-11-29 16:18:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667082  77 58451 58737557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:18:57 [DEBUG   ] Got command RPT from MCS: ref #667083
2018-11-29 16:18:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667083  12 58451 58737761 A  ERRORB™™š'
2018-11-29 16:19:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 16:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:19:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 16:19:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:19:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:19:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:19:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:19:12 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-29 16:19:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:19:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 16:20:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:20:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:20:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:20:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:20:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:20:12 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-11-29 16:20:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:20:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:20:49 [DEBUG   ] Got command RPT from MCS: ref #667088
2018-11-29 16:20:49 [DEBUG   ] summary = ERROR
2018-11-29 16:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667088  13 58451 58849733 A  ERRORERROR'
2018-11-29 16:20:49 [DEBUG   ] Got command RPT from MCS: ref #667089
2018-11-29 16:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667089  77 58451 58849734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:21:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 16:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:21:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:21:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:21:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:21:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:21:12 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-29 16:21:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:21:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 16:22:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:22:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:22:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:22:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:22:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:22:12 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-11-29 16:22:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 16:22:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:23:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:23:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:23:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:23:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:23:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:23:12 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-11-29 16:23:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:23:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 16:23:57 [DEBUG   ] Got command RPT from MCS: ref #667111
2018-11-29 16:23:57 [DEBUG   ] summary = ERROR
2018-11-29 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667111  13 58451 59037033 A  ERRORERROR'
2018-11-29 16:23:57 [DEBUG   ] Got command RPT from MCS: ref #667112
2018-11-29 16:23:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667112  77 58451 59037237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:23:57 [DEBUG   ] Got command RPT from MCS: ref #667113
2018-11-29 16:23:57 [DEBUG   ] summary = ERROR
2018-11-29 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667113  13 58451 59037441 A  ERRORERROR'
2018-11-29 16:23:57 [DEBUG   ] Got command RPT from MCS: ref #667115
2018-11-29 16:23:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667115  77 58451 59037633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:23:57 [DEBUG   ] Got command RPT from MCS: ref #667116
2018-11-29 16:23:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667116  12 58451 59037837 A  ERRORB™™š'
2018-11-29 16:24:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-29 16:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:24:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:24:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:24:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:24:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:24:12 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-11-29 16:24:21 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-29 16:24:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 16:25:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 16:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:25:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:25:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:25:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:25:12 [WARNING ] (13, 1, 'bot')
2018-11-29 16:25:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:25:12 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-11-29 16:25:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 16:25:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:25:49 [DEBUG   ] Got command RPT from MCS: ref #667121
2018-11-29 16:25:49 [DEBUG   ] summary = ERROR
2018-11-29 16:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667121  13 58451 59149737 A  ERRORERROR'
2018-11-29 16:25:49 [DEBUG   ] Got command RPT from MCS: ref #667122
2018-11-29 16:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667122  77 58451 59149738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:26:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 16:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:26:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:26:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:26:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:26:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:26:13 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-11-29 16:26:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 16:26:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:27:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:27:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:27:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:27:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:27:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:27:13 [DEBUG   ] Finished updating board flags in 1.938 seconds
2018-11-29 16:27:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 16:27:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 16:28:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-29 16:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:28:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:28:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:28:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:28:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:28:13 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-29 16:28:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 16:28:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 16:28:57 [DEBUG   ] Got command RPT from MCS: ref #667142
2018-11-29 16:28:57 [DEBUG   ] summary = ERROR
2018-11-29 16:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667142  13 58451 59337125 A  ERRORERROR'
2018-11-29 16:28:57 [DEBUG   ] Got command RPT from MCS: ref #667143
2018-11-29 16:28:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667143  77 58451 59337329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:28:57 [DEBUG   ] Got command RPT from MCS: ref #667144
2018-11-29 16:28:57 [DEBUG   ] summary = ERROR
2018-11-29 16:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667144  13 58451 59337521 A  ERRORERROR'
2018-11-29 16:28:57 [DEBUG   ] Got command RPT from MCS: ref #667145
2018-11-29 16:28:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667145  77 58451 59337725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:28:57 [DEBUG   ] Got command RPT from MCS: ref #667146
2018-11-29 16:28:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667146  12 58451 59337929 A  ERRORB˜™š'
2018-11-29 16:29:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 16:29:12 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 16:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:29:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:29:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:29:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:29:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:29:13 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-11-29 16:29:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-29 16:29:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 16:30:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 16:30:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:30:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:30:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:30:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:30:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:30:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:30:13 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-29 16:30:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 16:30:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:30:49 [DEBUG   ] Got command RPT from MCS: ref #667151
2018-11-29 16:30:49 [DEBUG   ] summary = ERROR
2018-11-29 16:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667151  13 58451 59449737 A  ERRORERROR'
2018-11-29 16:30:49 [DEBUG   ] Got command RPT from MCS: ref #667152
2018-11-29 16:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667152  77 58451 59449738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:31:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:31:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 16:31:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:31:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:31:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:31:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:31:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:31:13 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-11-29 16:31:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:31:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 16:32:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:32:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:32:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:32:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:32:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:32:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:32:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:32:13 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-29 16:32:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 16:32:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:33:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:33:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:33:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:33:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:33:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:33:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:33:13 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-11-29 16:33:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:33:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 16:33:57 [DEBUG   ] Got command RPT from MCS: ref #667174
2018-11-29 16:33:57 [DEBUG   ] summary = ERROR
2018-11-29 16:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667174  13 58451 59637205 A  ERRORERROR'
2018-11-29 16:33:57 [DEBUG   ] Got command RPT from MCS: ref #667175
2018-11-29 16:33:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667175  77 58451 59637409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:33:57 [DEBUG   ] Got command RPT from MCS: ref #667176
2018-11-29 16:33:57 [DEBUG   ] summary = ERROR
2018-11-29 16:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667176  13 58451 59637613 A  ERRORERROR'
2018-11-29 16:33:57 [DEBUG   ] Got command RPT from MCS: ref #667178
2018-11-29 16:33:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:33:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667178  77 58451 59637805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:33:58 [DEBUG   ] Got command RPT from MCS: ref #667179
2018-11-29 16:33:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667179  12 58451 59638009 A  ERRORB˜™š'
2018-11-29 16:34:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:34:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:34:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:34:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:34:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:34:13 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-11-29 16:34:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 16:34:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:35:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 16:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:35:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:35:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:35:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:35:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:35:13 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-11-29 16:35:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-29 16:35:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 16:35:49 [DEBUG   ] Got command RPT from MCS: ref #667188
2018-11-29 16:35:49 [DEBUG   ] summary = ERROR
2018-11-29 16:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667188  13 58451 59749745 A  ERRORERROR'
2018-11-29 16:35:49 [DEBUG   ] Got command RPT from MCS: ref #667189
2018-11-29 16:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667189  77 58451 59749746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:36:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-29 16:36:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:36:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:36:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:36:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:36:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:36:13 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-29 16:36:23 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-29 16:36:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:37:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 16:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:37:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:37:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:37:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:37:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:37:13 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-29 16:37:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 16:37:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:38:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 16:38:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:38:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:38:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:38:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:38:13 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-29 16:38:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 16:38:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:38:57 [DEBUG   ] Got command RPT from MCS: ref #667209
2018-11-29 16:38:57 [DEBUG   ] summary = ERROR
2018-11-29 16:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667209  13 58451 59937293 A  ERRORERROR'
2018-11-29 16:38:57 [DEBUG   ] Got command RPT from MCS: ref #667210
2018-11-29 16:38:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667210  77 58451 59937497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:38:57 [DEBUG   ] Got command RPT from MCS: ref #667211
2018-11-29 16:38:57 [DEBUG   ] summary = ERROR
2018-11-29 16:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667211  13 58451 59937689 A  ERRORERROR'
2018-11-29 16:38:57 [DEBUG   ] Got command RPT from MCS: ref #667212
2018-11-29 16:38:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667212  77 58451 59937893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:38:58 [DEBUG   ] Got command RPT from MCS: ref #667213
2018-11-29 16:38:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667213  12 58451 59938097 A  ERRORB™™š'
2018-11-29 16:39:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:39:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:39:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:39:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:39:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:39:13 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-29 16:39:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:39:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 16:40:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 16:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:40:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 16:40:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:40:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:40:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:40:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:40:13 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-29 16:40:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 16:40:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 16:40:49 [DEBUG   ] Got command RPT from MCS: ref #667214
2018-11-29 16:40:49 [DEBUG   ] summary = ERROR
2018-11-29 16:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667214  13 58451 60049745 A  ERRORERROR'
2018-11-29 16:40:49 [DEBUG   ] Got command RPT from MCS: ref #667215
2018-11-29 16:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667215  77 58451 60049746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:41:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 16:41:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 16:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:41:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 16:41:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:41:13 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-29 16:41:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 16:41:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 16:42:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 16:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-29 16:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:42:13 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-11-29 16:42:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:42:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:43:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 16:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:43:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:43:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:43:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:43:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:43:14 [DEBUG   ] Finished updating board flags in 2.242 seconds
2018-11-29 16:43:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 16:43:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:43:57 [DEBUG   ] Got command RPT from MCS: ref #667237
2018-11-29 16:43:57 [DEBUG   ] summary = ERROR
2018-11-29 16:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667237  13 58451 60237381 A  ERRORERROR'
2018-11-29 16:43:57 [DEBUG   ] Got command RPT from MCS: ref #667238
2018-11-29 16:43:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667238  77 58451 60237573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:43:57 [DEBUG   ] Got command RPT from MCS: ref #667239
2018-11-29 16:43:57 [DEBUG   ] summary = ERROR
2018-11-29 16:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667239  13 58451 60237777 A  ERRORERROR'
2018-11-29 16:43:57 [DEBUG   ] Got command RPT from MCS: ref #667241
2018-11-29 16:43:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:43:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667241  77 58451 60237981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:43:58 [DEBUG   ] Got command RPT from MCS: ref #667243
2018-11-29 16:43:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667243  12 58451 60238185 A  ERRORB™™š'
2018-11-29 16:44:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:44:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 16:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:44:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:44:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:44:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:44:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:44:14 [DEBUG   ] Finished updating board flags in 2.146 seconds
2018-11-29 16:44:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-29 16:44:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 16:45:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 16:45:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:45:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:45:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:45:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:45:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:45:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:45:14 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-11-29 16:45:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-29 16:45:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 16:45:49 [DEBUG   ] Got command RPT from MCS: ref #667251
2018-11-29 16:45:49 [DEBUG   ] summary = ERROR
2018-11-29 16:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667251  13 58451 60349745 A  ERRORERROR'
2018-11-29 16:45:49 [DEBUG   ] Got command RPT from MCS: ref #667252
2018-11-29 16:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667252  77 58451 60349746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:46:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:46:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:46:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:46:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:46:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:46:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:46:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:46:14 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-29 16:46:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 16:46:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:47:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 16:47:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:47:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:47:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:47:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:47:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:47:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:47:14 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-29 16:47:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:47:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 16:48:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:48:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:48:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:48:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:48:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:48:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:48:14 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-29 16:48:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 16:48:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:48:57 [DEBUG   ] Got command RPT from MCS: ref #667272
2018-11-29 16:48:57 [DEBUG   ] summary = ERROR
2018-11-29 16:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667272  13 58451 60537465 A  ERRORERROR'
2018-11-29 16:48:57 [DEBUG   ] Got command RPT from MCS: ref #667273
2018-11-29 16:48:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667273  77 58451 60537669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:48:57 [DEBUG   ] Got command RPT from MCS: ref #667274
2018-11-29 16:48:57 [DEBUG   ] summary = ERROR
2018-11-29 16:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667274  13 58451 60537861 A  ERRORERROR'
2018-11-29 16:48:58 [DEBUG   ] Got command RPT from MCS: ref #667275
2018-11-29 16:48:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667275  77 58451 60538065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:48:58 [DEBUG   ] Got command RPT from MCS: ref #667276
2018-11-29 16:48:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667276  12 58451 60538269 A  ERRORB˜™š'
2018-11-29 16:49:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:49:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:49:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:49:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:49:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:49:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:49:14 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-11-29 16:49:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 16:49:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 16:50:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 16:50:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:50:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:50:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:50:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:50:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:50:14 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-11-29 16:50:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 16:50:46 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-29 16:50:49 [DEBUG   ] Got command RPT from MCS: ref #667281
2018-11-29 16:50:49 [DEBUG   ] summary = ERROR
2018-11-29 16:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667281  13 58451 60649737 A  ERRORERROR'
2018-11-29 16:50:49 [DEBUG   ] Got command RPT from MCS: ref #667282
2018-11-29 16:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667282  77 58451 60649738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:51:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 16:51:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:51:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:51:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:51:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:51:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:51:14 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-29 16:51:26 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-29 16:51:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 16:52:06 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-29 16:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:52:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:52:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:52:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:52:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:52:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:52:14 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-11-29 16:52:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 16:52:46 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-29 16:53:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 16:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-29 16:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:53:14 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-29 16:53:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 16:53:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 16:53:57 [DEBUG   ] Got command RPT from MCS: ref #667304
2018-11-29 16:53:57 [DEBUG   ] summary = ERROR
2018-11-29 16:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667304  13 58451 60837549 A  ERRORERROR'
2018-11-29 16:53:57 [DEBUG   ] Got command RPT from MCS: ref #667305
2018-11-29 16:53:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667305  77 58451 60837753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:53:57 [DEBUG   ] Got command RPT from MCS: ref #667306
2018-11-29 16:53:57 [DEBUG   ] summary = ERROR
2018-11-29 16:53:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667306  13 58451 60837945 A  ERRORERROR'
2018-11-29 16:53:58 [DEBUG   ] Got command RPT from MCS: ref #667308
2018-11-29 16:53:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667308  77 58451 60838149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:53:58 [DEBUG   ] Got command RPT from MCS: ref #667309
2018-11-29 16:53:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667309  12 58451 60838353 A  ERRORB˜™š'
2018-11-29 16:54:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 16:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:54:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:54:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:54:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:54:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:54:15 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-11-29 16:54:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 16:54:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 16:55:06 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-29 16:55:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:55:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 16:55:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:55:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:55:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:55:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:55:15 [DEBUG   ] Finished updating board flags in 2.411 seconds
2018-11-29 16:55:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 16:55:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 16:55:49 [DEBUG   ] Got command RPT from MCS: ref #667314
2018-11-29 16:55:49 [DEBUG   ] summary = ERROR
2018-11-29 16:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667314  13 58451 60949745 A  ERRORERROR'
2018-11-29 16:55:49 [DEBUG   ] Got command RPT from MCS: ref #667315
2018-11-29 16:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667315  77 58451 60949746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:56:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 16:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:56:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 16:56:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:56:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:56:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:56:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:56:15 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-11-29 16:56:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 16:56:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:57:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 16:57:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:57:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 16:57:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:57:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:57:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:57:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:57:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:57:15 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-11-29 16:57:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 16:57:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 16:58:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 16:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 16:58:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:58:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:58:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:58:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:58:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:58:15 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-29 16:58:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 16:58:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 16:58:57 [DEBUG   ] Got command RPT from MCS: ref #667335
2018-11-29 16:58:57 [DEBUG   ] summary = ERROR
2018-11-29 16:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667335  13 58451 61137633 A  ERRORERROR'
2018-11-29 16:58:57 [DEBUG   ] Got command RPT from MCS: ref #667336
2018-11-29 16:58:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667336  77 58451 61137837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:58:58 [DEBUG   ] Got command RPT from MCS: ref #667337
2018-11-29 16:58:58 [DEBUG   ] summary = ERROR
2018-11-29 16:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667337  13 58451 61138041 A  ERRORERROR'
2018-11-29 16:58:58 [DEBUG   ] Got command RPT from MCS: ref #667338
2018-11-29 16:58:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 16:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667338  77 58451 61138233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 16:58:58 [DEBUG   ] Got command RPT from MCS: ref #667339
2018-11-29 16:58:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 16:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667339  12 58451 61138437 A  ERRORB™™š'
2018-11-29 16:59:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 16:59:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 16:59:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:59:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:59:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:59:15 [WARNING ] (13, 1, 'bot')
2018-11-29 16:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 16:59:15 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-29 16:59:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 16:59:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-29 17:00:07 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-11-29 17:00:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:00:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 17:00:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:00:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:00:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:00:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:00:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:00:15 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-29 17:00:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:00:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 17:00:49 [DEBUG   ] Got command RPT from MCS: ref #667344
2018-11-29 17:00:49 [DEBUG   ] summary = ERROR
2018-11-29 17:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667344  13 58451 61249749 A  ERRORERROR'
2018-11-29 17:00:49 [DEBUG   ] Got command RPT from MCS: ref #667345
2018-11-29 17:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667345  77 58451 61249750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:01:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:01:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:01:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:01:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:01:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:01:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:01:15 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-11-29 17:01:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:01:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:02:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 17:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:02:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:02:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:02:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:02:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:02:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:02:15 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-29 17:02:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:02:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:03:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:03:15 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-29 17:03:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 17:03:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 17:03:57 [DEBUG   ] Got command RPT from MCS: ref #667367
2018-11-29 17:03:57 [DEBUG   ] summary = ERROR
2018-11-29 17:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667367  13 58451 61437717 A  ERRORERROR'
2018-11-29 17:03:57 [DEBUG   ] Got command RPT from MCS: ref #667368
2018-11-29 17:03:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667368  77 58451 61437921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:03:58 [DEBUG   ] Got command RPT from MCS: ref #667369
2018-11-29 17:03:58 [DEBUG   ] summary = ERROR
2018-11-29 17:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667369  13 58451 61438125 A  ERRORERROR'
2018-11-29 17:03:58 [DEBUG   ] Got command RPT from MCS: ref #667371
2018-11-29 17:03:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667371  77 58451 61438329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:03:58 [DEBUG   ] Got command RPT from MCS: ref #667372
2018-11-29 17:03:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667372  12 58451 61438521 A  ERRORB™™š'
2018-11-29 17:04:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 17:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 17:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 17:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:04:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:04:15 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-11-29 17:04:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 17:04:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 17:05:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 17:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:05:15 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-11-29 17:05:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 17:05:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 17:05:49 [DEBUG   ] Got command RPT from MCS: ref #667381
2018-11-29 17:05:49 [DEBUG   ] summary = ERROR
2018-11-29 17:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667381  13 58451 61549741 A  ERRORERROR'
2018-11-29 17:05:49 [DEBUG   ] Got command RPT from MCS: ref #667382
2018-11-29 17:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667382  77 58451 61549742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:06:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:06:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:06:15 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-29 17:06:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:06:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:07:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:07:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:07:15 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-11-29 17:07:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:07:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:08:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 17:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:08:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:08:15 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-11-29 17:08:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 17:08:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:08:57 [DEBUG   ] Got command RPT from MCS: ref #667402
2018-11-29 17:08:57 [DEBUG   ] summary = ERROR
2018-11-29 17:08:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667402  13 58451 61737813 A  ERRORERROR'
2018-11-29 17:08:58 [DEBUG   ] Got command RPT from MCS: ref #667403
2018-11-29 17:08:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667403  77 58451 61738005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:08:58 [DEBUG   ] Got command RPT from MCS: ref #667404
2018-11-29 17:08:58 [DEBUG   ] summary = ERROR
2018-11-29 17:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667404  13 58451 61738209 A  ERRORERROR'
2018-11-29 17:08:58 [DEBUG   ] Got command RPT from MCS: ref #667405
2018-11-29 17:08:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667405  77 58451 61738413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:08:58 [DEBUG   ] Got command RPT from MCS: ref #667406
2018-11-29 17:08:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667406  12 58451 61738605 A  ERRORB˜™š'
2018-11-29 17:09:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:09:15 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-29 17:09:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:09:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:10:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:10:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:10:15 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-11-29 17:10:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:10:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:10:49 [DEBUG   ] Got command RPT from MCS: ref #667407
2018-11-29 17:10:49 [DEBUG   ] summary = ERROR
2018-11-29 17:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667407  13 58451 61849745 A  ERRORERROR'
2018-11-29 17:10:49 [DEBUG   ] Got command RPT from MCS: ref #667408
2018-11-29 17:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667408  77 58451 61849746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:11:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 17:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-29 17:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:11:15 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-11-29 17:11:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 17:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 17:12:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 17:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:12:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:12:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:12:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:12:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:12:16 [DEBUG   ] Finished updating board flags in 2.198 seconds
2018-11-29 17:12:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 17:12:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-29 17:13:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-29 17:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:13:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:13:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:13:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:13:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:13:16 [DEBUG   ] Finished updating board flags in 1.905 seconds
2018-11-29 17:13:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 17:13:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:13:57 [DEBUG   ] Got command RPT from MCS: ref #667430
2018-11-29 17:13:57 [DEBUG   ] summary = ERROR
2018-11-29 17:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667430  13 58451 62037893 A  ERRORERROR'
2018-11-29 17:13:58 [DEBUG   ] Got command RPT from MCS: ref #667431
2018-11-29 17:13:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667431  77 58451 62038097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:13:58 [DEBUG   ] Got command RPT from MCS: ref #667432
2018-11-29 17:13:58 [DEBUG   ] summary = ERROR
2018-11-29 17:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667432  13 58451 62038289 A  ERRORERROR'
2018-11-29 17:13:58 [DEBUG   ] Got command RPT from MCS: ref #667434
2018-11-29 17:13:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667434  77 58451 62038493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:13:58 [DEBUG   ] Got command RPT from MCS: ref #667435
2018-11-29 17:13:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667435  12 58451 62038697 A  ERRORB˜™š'
2018-11-29 17:14:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:14:16 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-29 17:14:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:14:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 17:15:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:15:16 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-29 17:15:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:15:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:15:49 [DEBUG   ] Got command RPT from MCS: ref #667444
2018-11-29 17:15:49 [DEBUG   ] summary = ERROR
2018-11-29 17:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667444  13 58451 62149745 A  ERRORERROR'
2018-11-29 17:15:49 [DEBUG   ] Got command RPT from MCS: ref #667445
2018-11-29 17:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667445  77 58451 62149746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:16:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-29 17:16:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:16:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:16:16 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-29 17:16:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:16:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:17:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:17:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:17:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:17:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:17:16 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-29 17:17:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:17:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:18:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:18:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:18:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:18:16 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-29 17:18:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:18:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 17:18:57 [DEBUG   ] Got command RPT from MCS: ref #667465
2018-11-29 17:18:57 [DEBUG   ] summary = ERROR
2018-11-29 17:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667465  13 58451 62337973 A  ERRORERROR'
2018-11-29 17:18:58 [DEBUG   ] Got command RPT from MCS: ref #667466
2018-11-29 17:18:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667466  77 58451 62338177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:18:58 [DEBUG   ] Got command RPT from MCS: ref #667467
2018-11-29 17:18:58 [DEBUG   ] summary = ERROR
2018-11-29 17:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667467  13 58451 62338381 A  ERRORERROR'
2018-11-29 17:18:58 [DEBUG   ] Got command RPT from MCS: ref #667468
2018-11-29 17:18:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667468  77 58451 62338573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:18:58 [DEBUG   ] Got command RPT from MCS: ref #667469
2018-11-29 17:18:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667469  12 58451 62338777 A  ERRORB˜™š'
2018-11-29 17:19:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 17:19:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:19:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:19:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:19:16 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-29 17:19:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 17:19:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-29 17:20:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-29 17:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:20:16 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-29 17:20:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:20:49 [DEBUG   ] Got command RPT from MCS: ref #667474
2018-11-29 17:20:49 [DEBUG   ] summary = ERROR
2018-11-29 17:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667474  13 58451 62449749 A  ERRORERROR'
2018-11-29 17:20:49 [DEBUG   ] Got command RPT from MCS: ref #667475
2018-11-29 17:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667475  77 58451 62449750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:20:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:21:10 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-29 17:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:21:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-29 17:21:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:21:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:22:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:22:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-29 17:22:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 17:22:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:23:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:23:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:23:16 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-29 17:23:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:23:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 17:23:58 [DEBUG   ] Got command RPT from MCS: ref #667497
2018-11-29 17:23:58 [DEBUG   ] summary = ERROR
2018-11-29 17:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667497  13 58451 62638061 A  ERRORERROR'
2018-11-29 17:23:58 [DEBUG   ] Got command RPT from MCS: ref #667498
2018-11-29 17:23:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667498  77 58451 62638265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:23:58 [DEBUG   ] Got command RPT from MCS: ref #667499
2018-11-29 17:23:58 [DEBUG   ] summary = ERROR
2018-11-29 17:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667499  13 58451 62638469 A  ERRORERROR'
2018-11-29 17:23:58 [DEBUG   ] Got command RPT from MCS: ref #667501
2018-11-29 17:23:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667501  77 58451 62638661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:23:58 [DEBUG   ] Got command RPT from MCS: ref #667503
2018-11-29 17:23:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667503  12 58451 62638865 A  ERRORB˜™š'
2018-11-29 17:24:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 17:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:24:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:24:16 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-29 17:24:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 17:24:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 17:25:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 17:25:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:25:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:25:16 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-11-29 17:25:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 17:25:49 [DEBUG   ] Got command RPT from MCS: ref #667507
2018-11-29 17:25:49 [DEBUG   ] summary = ERROR
2018-11-29 17:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667507  13 58451 62749746 A  ERRORERROR'
2018-11-29 17:25:49 [DEBUG   ] Got command RPT from MCS: ref #667508
2018-11-29 17:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667508  77 58451 62749746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:25:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 17:26:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 17:26:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:26:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-29 17:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:26:16 [DEBUG   ] Finished updating board flags in 1.516 seconds
2018-11-29 17:26:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-29 17:26:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 17:27:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-29 17:27:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:27:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:27:17 [DEBUG   ] Finished updating board flags in 2.173 seconds
2018-11-29 17:27:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-29 17:27:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:28:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:28:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:28:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 17:28:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:28:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:28:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:28:17 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-29 17:28:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:28:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:28:58 [DEBUG   ] Got command RPT from MCS: ref #667528
2018-11-29 17:28:58 [DEBUG   ] summary = ERROR
2018-11-29 17:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667528  13 58451 62938153 A  ERRORERROR'
2018-11-29 17:28:58 [DEBUG   ] Got command RPT from MCS: ref #667529
2018-11-29 17:28:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667529  77 58451 62938345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:28:58 [DEBUG   ] Got command RPT from MCS: ref #667530
2018-11-29 17:28:58 [DEBUG   ] summary = ERROR
2018-11-29 17:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667530  13 58451 62938549 A  ERRORERROR'
2018-11-29 17:28:58 [DEBUG   ] Got command RPT from MCS: ref #667531
2018-11-29 17:28:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667531  77 58451 62938753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:28:58 [DEBUG   ] Got command RPT from MCS: ref #667532
2018-11-29 17:28:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667532  12 58451 62938957 A  ERRORBš™š'
2018-11-29 17:29:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:29:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:29:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:29:17 [DEBUG   ] Finished updating board flags in 1.923 seconds
2018-11-29 17:29:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:29:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 17:30:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:30:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:30:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:30:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:30:17 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-11-29 17:30:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:30:49 [DEBUG   ] Got command RPT from MCS: ref #667537
2018-11-29 17:30:49 [DEBUG   ] summary = ERROR
2018-11-29 17:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667537  13 58451 63049753 A  ERRORERROR'
2018-11-29 17:30:49 [DEBUG   ] Got command RPT from MCS: ref #667538
2018-11-29 17:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667538  77 58451 63049754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:30:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:31:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 17:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 17:31:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:31:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:31:17 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-11-29 17:31:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:31:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:32:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:32:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:32:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:32:17 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-29 17:32:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:32:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:33:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:33:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:33:17 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-11-29 17:33:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:33:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:33:58 [DEBUG   ] Got command RPT from MCS: ref #667560
2018-11-29 17:33:58 [DEBUG   ] summary = ERROR
2018-11-29 17:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667560  13 58451 63238229 A  ERRORERROR'
2018-11-29 17:33:58 [DEBUG   ] Got command RPT from MCS: ref #667561
2018-11-29 17:33:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667561  77 58451 63238433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:33:58 [DEBUG   ] Got command RPT from MCS: ref #667562
2018-11-29 17:33:58 [DEBUG   ] summary = ERROR
2018-11-29 17:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667562  13 58451 63238637 A  ERRORERROR'
2018-11-29 17:33:58 [DEBUG   ] Got command RPT from MCS: ref #667564
2018-11-29 17:33:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667564  77 58451 63238829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:33:59 [DEBUG   ] Got command RPT from MCS: ref #667565
2018-11-29 17:33:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667565  12 58451 63239037 A  ERRORB™™š'
2018-11-29 17:34:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:34:17 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-11-29 17:34:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:34:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:35:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 17:35:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:35:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:35:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:35:17 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-29 17:35:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 17:35:49 [DEBUG   ] Got command RPT from MCS: ref #667574
2018-11-29 17:35:49 [DEBUG   ] summary = ERROR
2018-11-29 17:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667574  13 58451 63349749 A  ERRORERROR'
2018-11-29 17:35:49 [DEBUG   ] Got command RPT from MCS: ref #667575
2018-11-29 17:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667575  77 58451 63349750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:35:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 17:36:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 17:36:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-29 17:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:36:17 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-11-29 17:36:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 17:36:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 17:37:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-29 17:37:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:37:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:37:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:37:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:37:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:37:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:37:18 [DEBUG   ] Finished updating board flags in 2.196 seconds
2018-11-29 17:37:31 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-11-29 17:37:52 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-11-29 17:38:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-29 17:38:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:38:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:38:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:38:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:38:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:38:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:38:18 [DEBUG   ] Finished updating board flags in 1.929 seconds
2018-11-29 17:38:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:38:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 17:38:58 [DEBUG   ] Got command RPT from MCS: ref #667595
2018-11-29 17:38:58 [DEBUG   ] summary = ERROR
2018-11-29 17:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667595  13 58451 63538317 A  ERRORERROR'
2018-11-29 17:38:58 [DEBUG   ] Got command RPT from MCS: ref #667596
2018-11-29 17:38:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667596  77 58451 63538521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:38:58 [DEBUG   ] Got command RPT from MCS: ref #667597
2018-11-29 17:38:58 [DEBUG   ] summary = ERROR
2018-11-29 17:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667597  13 58451 63538725 A  ERRORERROR'
2018-11-29 17:38:58 [DEBUG   ] Got command RPT from MCS: ref #667598
2018-11-29 17:38:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667598  77 58451 63538917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:38:59 [DEBUG   ] Got command RPT from MCS: ref #667599
2018-11-29 17:38:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667599  12 58451 63539121 A  ERRORB˜™š'
2018-11-29 17:39:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 17:39:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:39:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:39:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:39:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:39:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:39:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:39:18 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-11-29 17:39:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:39:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-29 17:40:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 17:40:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:40:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:40:18 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-29 17:40:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:40:49 [DEBUG   ] Got command RPT from MCS: ref #667600
2018-11-29 17:40:49 [DEBUG   ] summary = ERROR
2018-11-29 17:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667600  13 58451 63649757 A  ERRORERROR'
2018-11-29 17:40:49 [DEBUG   ] Got command RPT from MCS: ref #667601
2018-11-29 17:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667601  77 58451 63649758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:40:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:41:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:41:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:41:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:41:18 [DEBUG   ] Finished updating board flags in 1.748 seconds
2018-11-29 17:41:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:41:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:42:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:42:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:42:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:42:18 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-11-29 17:42:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:42:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:43:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-29 17:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:43:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:43:18 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-11-29 17:43:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:43:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:43:58 [DEBUG   ] Got command RPT from MCS: ref #667623
2018-11-29 17:43:58 [DEBUG   ] summary = ERROR
2018-11-29 17:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667623  13 58451 63838405 A  ERRORERROR'
2018-11-29 17:43:58 [DEBUG   ] Got command RPT from MCS: ref #667624
2018-11-29 17:43:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667624  77 58451 63838609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:43:58 [DEBUG   ] Got command RPT from MCS: ref #667625
2018-11-29 17:43:58 [DEBUG   ] summary = ERROR
2018-11-29 17:43:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667625  13 58451 63838813 A  ERRORERROR'
2018-11-29 17:43:59 [DEBUG   ] Got command RPT from MCS: ref #667627
2018-11-29 17:43:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667627  77 58451 63839005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:43:59 [DEBUG   ] Got command RPT from MCS: ref #667628
2018-11-29 17:43:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667628  12 58451 63839209 A  ERRORB˜™š'
2018-11-29 17:44:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:44:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:44:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:44:18 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-11-29 17:44:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:44:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:45:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-29 17:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:45:18 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-11-29 17:45:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 17:45:49 [DEBUG   ] Got command RPT from MCS: ref #667637
2018-11-29 17:45:49 [DEBUG   ] summary = ERROR
2018-11-29 17:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667637  13 58451 63949749 A  ERRORERROR'
2018-11-29 17:45:49 [DEBUG   ] Got command RPT from MCS: ref #667638
2018-11-29 17:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667638  77 58451 63949750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:45:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:46:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 17:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:46:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:46:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:46:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:46:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:46:19 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-11-29 17:46:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-29 17:46:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 17:47:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:47:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:47:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:47:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:47:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:47:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:47:19 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-11-29 17:47:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:47:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:48:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:48:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:48:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:48:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:48:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:48:19 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-11-29 17:48:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:48:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:48:58 [DEBUG   ] Got command RPT from MCS: ref #667658
2018-11-29 17:48:58 [DEBUG   ] summary = ERROR
2018-11-29 17:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667658  13 58451 64138493 A  ERRORERROR'
2018-11-29 17:48:58 [DEBUG   ] Got command RPT from MCS: ref #667659
2018-11-29 17:48:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667659  77 58451 64138685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:48:58 [DEBUG   ] Got command RPT from MCS: ref #667660
2018-11-29 17:48:58 [DEBUG   ] summary = ERROR
2018-11-29 17:48:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667660  13 58451 64138889 A  ERRORERROR'
2018-11-29 17:48:59 [DEBUG   ] Got command RPT from MCS: ref #667661
2018-11-29 17:48:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667661  77 58451 64139093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:48:59 [DEBUG   ] Got command RPT from MCS: ref #667662
2018-11-29 17:48:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667662  12 58451 64139285 A  ERRORB™™š'
2018-11-29 17:49:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:49:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:49:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:49:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:49:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:49:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:49:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:49:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:49:19 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-11-29 17:49:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:49:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:50:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:50:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:50:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:50:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:50:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:50:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:50:19 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-29 17:50:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:50:49 [DEBUG   ] Got command RPT from MCS: ref #667667
2018-11-29 17:50:49 [DEBUG   ] summary = ERROR
2018-11-29 17:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667667  13 58451 64249761 A  ERRORERROR'
2018-11-29 17:50:49 [DEBUG   ] Got command RPT from MCS: ref #667668
2018-11-29 17:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667668  77 58451 64249762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:50:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:51:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:51:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:51:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:51:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:51:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:51:19 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-11-29 17:51:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:51:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:52:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:52:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:52:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:52:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:52:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:52:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:52:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:52:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:52:19 [DEBUG   ] Finished updating board flags in 1.699 seconds
2018-11-29 17:52:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:52:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:53:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:53:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:53:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:53:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:53:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:53:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:53:19 [DEBUG   ] Finished updating board flags in 1.643 seconds
2018-11-29 17:53:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:53:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:53:58 [DEBUG   ] Got command RPT from MCS: ref #667690
2018-11-29 17:53:58 [DEBUG   ] summary = ERROR
2018-11-29 17:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667690  13 58451 64438569 A  ERRORERROR'
2018-11-29 17:53:58 [DEBUG   ] Got command RPT from MCS: ref #667691
2018-11-29 17:53:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667691  77 58451 64438773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:53:58 [DEBUG   ] Got command RPT from MCS: ref #667692
2018-11-29 17:53:58 [DEBUG   ] summary = ERROR
2018-11-29 17:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667692  13 58451 64438977 A  ERRORERROR'
2018-11-29 17:53:59 [DEBUG   ] Got command RPT from MCS: ref #667694
2018-11-29 17:53:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667694  77 58451 64439181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:53:59 [DEBUG   ] Got command RPT from MCS: ref #667696
2018-11-29 17:53:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667696  12 58451 64439373 A  ERRORBš™š'
2018-11-29 17:54:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:54:19 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-29 17:54:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:54:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:55:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:55:19 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-11-29 17:55:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:55:49 [DEBUG   ] Got command RPT from MCS: ref #667700
2018-11-29 17:55:49 [DEBUG   ] summary = ERROR
2018-11-29 17:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667700  13 58451 64549753 A  ERRORERROR'
2018-11-29 17:55:49 [DEBUG   ] Got command RPT from MCS: ref #667701
2018-11-29 17:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667701  77 58451 64549754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:55:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:56:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 17:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:56:19 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-11-29 17:56:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:56:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 17:57:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-29 17:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:57:19 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-11-29 17:57:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:57:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:58:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 17:58:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 17:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:58:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:58:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:58:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:58:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:58:20 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-11-29 17:58:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 17:58:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:58:58 [DEBUG   ] Got command RPT from MCS: ref #667721
2018-11-29 17:58:58 [DEBUG   ] summary = ERROR
2018-11-29 17:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667721  13 58451 64738653 A  ERRORERROR'
2018-11-29 17:58:58 [DEBUG   ] Got command RPT from MCS: ref #667722
2018-11-29 17:58:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667722  77 58451 64738857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:58:59 [DEBUG   ] Got command RPT from MCS: ref #667723
2018-11-29 17:58:59 [DEBUG   ] summary = ERROR
2018-11-29 17:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667723  13 58451 64739061 A  ERRORERROR'
2018-11-29 17:58:59 [DEBUG   ] Got command RPT from MCS: ref #667724
2018-11-29 17:58:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 17:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667724  77 58451 64739265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 17:58:59 [DEBUG   ] Got command RPT from MCS: ref #667725
2018-11-29 17:58:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 17:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667725  12 58451 64739457 A  ERRORB™™š'
2018-11-29 17:59:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:59:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 17:59:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:59:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:59:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:59:20 [WARNING ] (13, 1, 'bot')
2018-11-29 17:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 17:59:20 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-11-29 17:59:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 17:59:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 18:00:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 18:00:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:00:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:00:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:00:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:00:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:00:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:00:20 [DEBUG   ] Finished updating board flags in 1.902 seconds
2018-11-29 18:00:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:00:49 [DEBUG   ] Got command RPT from MCS: ref #667730
2018-11-29 18:00:49 [DEBUG   ] summary = ERROR
2018-11-29 18:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667730  13 58451 64849761 A  ERRORERROR'
2018-11-29 18:00:49 [DEBUG   ] Got command RPT from MCS: ref #667731
2018-11-29 18:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667731  77 58451 64849762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:00:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 18:01:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-29 18:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:01:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:01:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:01:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:01:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:01:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:01:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:01:20 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-29 18:01:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 18:01:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:02:00 [DEBUG   ] Got command RPT from MCS: ref #667747
2018-11-29 18:02:00 [DEBUG   ] summary = ERROR
2018-11-29 18:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667747  13 58451 64920925 A  ERRORERROR'
2018-11-29 18:02:00 [DEBUG   ] Got command RPT from MCS: ref #667748
2018-11-29 18:02:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667748  77 58451 64920926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:02:05 [DEBUG   ] Got command INI from MCS: ref #667749
2018-11-29 18:02:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-29 18:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   667749   8 58451 64925946 ABOOTING'
2018-11-29 18:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:02:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:02:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:02:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:02:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:02:20 [WARNING ] (13, 1, 'bot')
2018-11-29 18:02:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:02:20 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-11-29 18:02:29 [INFO    ] -------------------
2018-11-29 18:02:29 [INFO    ]  LWA board status
2018-11-29 18:02:29 [INFO    ] -------------------
2018-11-29 18:02:29 [INFO    ] DP 1: 2 lwa27
2018-11-29 18:02:29 [INFO    ] DP 1: 3 lwa24
2018-11-29 18:02:29 [INFO    ] DP 1: 4 lwa23
2018-11-29 18:02:29 [INFO    ] DP 1: 5 lwa18
2018-11-29 18:02:29 [INFO    ] DP 1: 6 lwa10
2018-11-29 18:02:29 [INFO    ] DP 1: 7 lwa32
2018-11-29 18:02:29 [INFO    ] DP 1: 8 lwa11
2018-11-29 18:02:29 [INFO    ] DP 1: 9 lwa30
2018-11-29 18:02:29 [INFO    ] DP 1: 10 lwa12
2018-11-29 18:02:29 [INFO    ] DP 1: 11 lwa8
2018-11-29 18:02:29 [INFO    ] DP 1: 12 lwa13
2018-11-29 18:02:29 [INFO    ] DP 1: 13 lwa26
2018-11-29 18:02:29 [INFO    ] DP 1: 14 lwa14
2018-11-29 18:02:29 [INFO    ] DP 1: 16 lwa22
2018-11-29 18:02:29 [INFO    ] DP 1: 17 lwa20
2018-11-29 18:02:29 [INFO    ] DP 1: 18 lwa1
2018-11-29 18:02:29 [INFO    ] DP 1: 19 lwa5
2018-11-29 18:02:29 [INFO    ] DP 1: 20 lwa25
2018-11-29 18:02:29 [INFO    ] DP 1: 21 lwa35
2018-11-29 18:02:29 [INFO    ] DP 1: 22 lwa19
2018-11-29 18:02:29 [INFO    ] DP 1: 23 lwa21
2018-11-29 18:02:29 [INFO    ] DP 1: 24 lwa6
2018-11-29 18:02:29 [INFO    ] DP 1: 25 lwa7
2018-11-29 18:02:29 [INFO    ] DP 1: 26 lwa33
2018-11-29 18:02:29 [INFO    ] DP 1: 27 lwa15
2018-11-29 18:02:29 [INFO    ] DP 1: 28 lwa28
2018-11-29 18:02:29 [INFO    ] DP 2: 1 lwa16
2018-11-29 18:02:29 [INFO    ] DP 2: 15 lwa34
2018-11-29 18:02:29 [INFO    ] Total of 28 boards
2018-11-29 18:02:29 [INFO    ] Total of 260 stands
2018-11-29 18:02:29 [INFO    ] -------------------
2018-11-29 18:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21373
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21374
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21375
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21376
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21377
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21378
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21379
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21380
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21381
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21382
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21383
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21384
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21385
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21386
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21387
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21388
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21389
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21390
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21391
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21392
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21393
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21394
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21395
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21396
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21397
2018-11-29 18:02:36 [DEBUG   ] 2018-11-29 18:02:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21398
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21373 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21374 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21375 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21376 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21377 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21378 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21379 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21380 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21381 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21382 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21383 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21384 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21385 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21386 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21387 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21388 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21389 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21390 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21391 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21392 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21393 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21394 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21395 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21396 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21397 exited with status 0
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21398 exited with status 0
2018-11-29 18:02:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] spawn_process: at 2018-11-29 18:02:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21425
2018-11-29 18:02:49 [DEBUG   ] 2018-11-29 18:02:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21426
2018-11-29 18:02:54 [DEBUG   ] 2018-11-29 18:02:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21425 exited with status 0
2018-11-29 18:02:54 [DEBUG   ] 2018-11-29 18:02:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21426 exited with status 0
2018-11-29 18:02:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-29 18:02:54 [DEBUG   ] spawn_process: at 2018-11-29 18:02:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-29 18:02:54 [DEBUG   ] spawn_process: at 2018-11-29 18:02:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-29 18:02:54 [INFO    ] Setting Beam 1 xbars
2018-11-29 18:02:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-29 18:02:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-29 18:02:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-29 18:02:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-29 18:02:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-29 18:02:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-29 18:02:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-29 18:02:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-29 18:02:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-29 18:03:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-29 18:03:00 [INFO    ] Setting Beam 2 xbars
2018-11-29 18:03:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-29 18:03:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-29 18:03:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-29 18:03:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-29 18:03:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-29 18:03:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-29 18:03:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-29 18:03:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-29 18:03:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-29 18:03:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-29 18:03:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-29 18:03:05 [INFO    ] Setting Beam 3 xbars
2018-11-29 18:03:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-29 18:03:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-29 18:03:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-29 18:03:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-29 18:03:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-29 18:03:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-29 18:03:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-29 18:03:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-29 18:03:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-29 18:03:10 [INFO    ] Setting Beam 4 xbars
2018-11-29 18:03:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-29 18:03:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-29 18:03:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-29 18:03:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-29 18:03:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-29 18:03:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-29 18:03:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-29 18:03:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-29 18:03:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-29 18:03:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-29 18:03:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-29 18:03:16 [INFO    ] All xbars set
2018-11-29 18:03:16 [INFO    ] Setting adder chain routing for all beams
2018-11-29 18:03:21 [INFO    ] Setting beam ids
2018-11-29 18:03:31 [INFO    ] Starting beam delay calibration
2018-11-29 18:03:43 [INFO    ] Beam 1 latency is 5737
2018-11-29 18:03:43 [INFO    ] Beam 2 latency is 5759
2018-11-29 18:03:43 [INFO    ] Beam 3 latency is 5751
2018-11-29 18:03:43 [INFO    ] Beam 4 latency is 5722
2018-11-29 18:03:43 [INFO    ] Stop calibration
2018-11-29 18:03:51 [INFO    ] Beam delay calibration successful
2018-11-29 18:03:51 [INFO    ] Calibration passed
2018-11-29 18:03:51 [DEBUG   ] spawn_process: at 2018-11-29 18:03:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-29 18:03:51 [DEBUG   ] spawn_process: at 2018-11-29 18:03:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-29 18:03:51 [DEBUG   ] spawn_process: at 2018-11-29 18:03:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-29 18:03:51 [DEBUG   ] spawn_process: at 2018-11-29 18:03:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-29 18:03:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-29 18:03:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-29 18:03:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1543514632.281 s) with PID 23004 and time 1543514633
2018-11-29 18:03:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-29 18:03:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 367 ms (1543514632.369 s) with PID 23007 and time 1543514633
2018-11-29 18:03:53 [DEBUG   ] Finished updating ant stats in 0.879 seconds
2018-11-29 18:03:53 [INFO    ] Started antennas statistics background thread
2018-11-29 18:03:53 [INFO    ] Started board flags background thread
2018-11-29 18:03:53 [INFO    ] Started BAM background thread
2018-11-29 18:03:53 [INFO    ] Finished the INI process (ref. #667749) in 107.544 s
2018-11-29 18:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:03:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:03:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:03:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:03:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:03:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-29 18:03:54 [DEBUG   ] Finished updating board flags in 1.067 seconds
2018-11-29 18:03:58 [DEBUG   ] Got command RPT from MCS: ref #667756
2018-11-29 18:03:58 [DEBUG   ] summary = ERROR
2018-11-29 18:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667756  13 58451 65038741 A  ERRORERROR'
2018-11-29 18:03:58 [DEBUG   ] Got command RPT from MCS: ref #667757
2018-11-29 18:03:58 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667757  98 58451 65038945 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:03:59 [DEBUG   ] Got command RPT from MCS: ref #667758
2018-11-29 18:03:59 [DEBUG   ] summary = ERROR
2018-11-29 18:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667758  13 58451 65039149 A  ERRORERROR'
2018-11-29 18:03:59 [DEBUG   ] Got command RPT from MCS: ref #667760
2018-11-29 18:03:59 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667760  98 58451 65039353 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:03:59 [DEBUG   ] Got command RPT from MCS: ref #667761
2018-11-29 18:03:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667761  12 58451 65039545 A  ERRORB˜™š'
2018-11-29 18:04:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:04:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:04:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:04:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:04:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:04:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:04:54 [WARNING ] (13, 1, 'bot')
2018-11-29 18:04:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-29 18:04:54 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-29 18:05:05 [DEBUG   ] Got command RPT from MCS: ref #667766
2018-11-29 18:05:05 [DEBUG   ] summary = ERROR
2018-11-29 18:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667766  13 58451 65105941 A  ERRORERROR'
2018-11-29 18:05:05 [DEBUG   ] Got command RPT from MCS: ref #667767
2018-11-29 18:05:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667767  98 58451 65105942 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:05:10 [DEBUG   ] Got command INI from MCS: ref #667771
2018-11-29 18:05:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-29 18:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   667771   8 58451 65110949 ABOOTING'
2018-11-29 18:05:13 [DEBUG   ] Finished updating ant stats in 0.819 seconds
2018-11-29 18:05:31 [INFO    ] -------------------
2018-11-29 18:05:31 [INFO    ]  LWA board status
2018-11-29 18:05:31 [INFO    ] -------------------
2018-11-29 18:05:31 [INFO    ] DP 1: 2 lwa27
2018-11-29 18:05:31 [INFO    ] DP 1: 3 lwa24
2018-11-29 18:05:31 [INFO    ] DP 1: 4 lwa23
2018-11-29 18:05:31 [INFO    ] DP 1: 5 lwa18
2018-11-29 18:05:31 [INFO    ] DP 1: 6 lwa10
2018-11-29 18:05:31 [INFO    ] DP 1: 7 lwa32
2018-11-29 18:05:31 [INFO    ] DP 1: 8 lwa11
2018-11-29 18:05:31 [INFO    ] DP 1: 9 lwa30
2018-11-29 18:05:31 [INFO    ] DP 1: 10 lwa12
2018-11-29 18:05:31 [INFO    ] DP 1: 11 lwa8
2018-11-29 18:05:31 [INFO    ] DP 1: 12 lwa13
2018-11-29 18:05:31 [INFO    ] DP 1: 13 lwa26
2018-11-29 18:05:31 [INFO    ] DP 1: 14 lwa14
2018-11-29 18:05:31 [INFO    ] DP 1: 16 lwa22
2018-11-29 18:05:31 [INFO    ] DP 1: 17 lwa20
2018-11-29 18:05:31 [INFO    ] DP 1: 18 lwa1
2018-11-29 18:05:31 [INFO    ] DP 1: 19 lwa5
2018-11-29 18:05:31 [INFO    ] DP 1: 20 lwa25
2018-11-29 18:05:31 [INFO    ] DP 1: 21 lwa35
2018-11-29 18:05:31 [INFO    ] DP 1: 22 lwa19
2018-11-29 18:05:31 [INFO    ] DP 1: 23 lwa21
2018-11-29 18:05:31 [INFO    ] DP 1: 24 lwa6
2018-11-29 18:05:31 [INFO    ] DP 1: 25 lwa7
2018-11-29 18:05:31 [INFO    ] DP 1: 26 lwa33
2018-11-29 18:05:31 [INFO    ] DP 1: 27 lwa15
2018-11-29 18:05:31 [INFO    ] DP 1: 28 lwa28
2018-11-29 18:05:31 [INFO    ] DP 2: 1 lwa16
2018-11-29 18:05:31 [INFO    ] DP 2: 15 lwa34
2018-11-29 18:05:31 [INFO    ] Total of 28 boards
2018-11-29 18:05:31 [INFO    ] Total of 260 stands
2018-11-29 18:05:31 [INFO    ] -------------------
2018-11-29 18:05:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23559
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23560
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23561
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23562
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23563
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23564
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23565
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23566
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23567
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23568
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23569
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23570
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23571
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23572
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23573
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23574
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23575
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23576
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23577
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23578
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23579
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23580
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23581
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23582
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23583
2018-11-29 18:05:38 [DEBUG   ] 2018-11-29 18:05:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23584
2018-11-29 18:05:49 [DEBUG   ] Got command RPT from MCS: ref #667773
2018-11-29 18:05:49 [DEBUG   ] summary = BOOTING
2018-11-29 18:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667773  15 58451 65149761 ABOOTINGBOOTING'
2018-11-29 18:05:49 [DEBUG   ] Got command RPT from MCS: ref #667774
2018-11-29 18:05:49 [DEBUG   ] info = Running INI sequence
2018-11-29 18:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667774  28 58451 65149762 ABOOTINGRunning INI sequence'
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23559 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23560 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23561 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23562 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23563 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23564 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23565 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23566 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23567 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23568 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23569 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23570 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23571 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23572 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23573 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23574 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23575 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23576 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23577 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23578 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23579 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23580 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23581 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23582 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23583 exited with status 0
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23584 exited with status 0
2018-11-29 18:05:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] spawn_process: at 2018-11-29 18:05:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23611
2018-11-29 18:05:50 [DEBUG   ] 2018-11-29 18:05:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23612
2018-11-29 18:05:56 [DEBUG   ] 2018-11-29 18:05:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23611 exited with status 0
2018-11-29 18:05:56 [DEBUG   ] 2018-11-29 18:05:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23612 exited with status 0
2018-11-29 18:05:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-29 18:05:56 [DEBUG   ] spawn_process: at 2018-11-29 18:05:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-29 18:05:56 [DEBUG   ] spawn_process: at 2018-11-29 18:05:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-29 18:05:56 [INFO    ] Setting Beam 1 xbars
2018-11-29 18:05:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-29 18:05:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-29 18:05:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-29 18:05:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-29 18:05:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-29 18:05:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-29 18:05:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-29 18:05:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-29 18:05:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-29 18:06:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-29 18:06:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-29 18:06:01 [INFO    ] Setting Beam 2 xbars
2018-11-29 18:06:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-29 18:06:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-29 18:06:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-29 18:06:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-29 18:06:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-29 18:06:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-29 18:06:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-29 18:06:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-29 18:06:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-29 18:06:07 [INFO    ] Setting Beam 3 xbars
2018-11-29 18:06:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-29 18:06:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-29 18:06:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-29 18:06:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-29 18:06:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-29 18:06:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-29 18:06:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-29 18:06:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-29 18:06:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-29 18:06:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-29 18:06:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-29 18:06:12 [INFO    ] Setting Beam 4 xbars
2018-11-29 18:06:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-29 18:06:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-29 18:06:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-29 18:06:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-29 18:06:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-29 18:06:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-29 18:06:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-29 18:06:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-29 18:06:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-29 18:06:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-29 18:06:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-29 18:06:18 [INFO    ] All xbars set
2018-11-29 18:06:18 [INFO    ] Setting adder chain routing for all beams
2018-11-29 18:06:23 [INFO    ] Setting beam ids
2018-11-29 18:06:33 [INFO    ] Starting beam delay calibration
2018-11-29 18:06:45 [INFO    ] Beam 1 latency is 5732
2018-11-29 18:06:45 [INFO    ] Beam 2 latency is 5746
2018-11-29 18:06:45 [INFO    ] Beam 3 latency is 5729
2018-11-29 18:06:45 [INFO    ] Beam 4 latency is 5727
2018-11-29 18:06:45 [INFO    ] Stop calibration
2018-11-29 18:06:53 [INFO    ] Beam delay calibration successful
2018-11-29 18:06:53 [INFO    ] Calibration passed
2018-11-29 18:06:53 [DEBUG   ] spawn_process: at 2018-11-29 18:06:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-29 18:06:53 [DEBUG   ] spawn_process: at 2018-11-29 18:06:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-29 18:06:53 [DEBUG   ] spawn_process: at 2018-11-29 18:06:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-29 18:06:53 [DEBUG   ] spawn_process: at 2018-11-29 18:06:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-29 18:06:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-29 18:06:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-11-29 18:06:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 556 ms (1543514813.558 s) with PID 25176 and time 1543514814
2018-11-29 18:06:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-11-29 18:06:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 294 ms (1543514814.296 s) with PID 25197 and time 1543514815
2018-11-29 18:06:55 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-11-29 18:06:55 [INFO    ] Started antennas statistics background thread
2018-11-29 18:06:55 [INFO    ] Started board flags background thread
2018-11-29 18:06:55 [INFO    ] Started BAM background thread
2018-11-29 18:06:55 [INFO    ] Finished the INI process (ref. #667771) in 104.470 s
2018-11-29 18:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:06:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:06:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:06:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:06:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:06:56 [DEBUG   ] Finished updating board flags in 1.139 seconds
2018-11-29 18:07:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:07:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:07:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:07:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:07:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:07:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:07:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:07:56 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-29 18:08:10 [DEBUG   ] Got command RPT from MCS: ref #667792
2018-11-29 18:08:10 [DEBUG   ] summary = ERROR
2018-11-29 18:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667792  13 58451 65290945 A  ERRORERROR'
2018-11-29 18:08:10 [DEBUG   ] Got command RPT from MCS: ref #667793
2018-11-29 18:08:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667793  77 58451 65290946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:08:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:08:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:08:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 18:08:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:08:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:08:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:08:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:08:56 [DEBUG   ] Finished updating board flags in 1.294 seconds
2018-11-29 18:08:58 [DEBUG   ] Got command RPT from MCS: ref #667796
2018-11-29 18:08:58 [DEBUG   ] summary = ERROR
2018-11-29 18:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667796  13 58451 65338825 A  ERRORERROR'
2018-11-29 18:08:59 [DEBUG   ] Got command RPT from MCS: ref #667797
2018-11-29 18:08:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667797  77 58451 65339029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:08:59 [DEBUG   ] Got command RPT from MCS: ref #667798
2018-11-29 18:08:59 [DEBUG   ] summary = ERROR
2018-11-29 18:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667798  13 58451 65339233 A  ERRORERROR'
2018-11-29 18:08:59 [DEBUG   ] Got command RPT from MCS: ref #667799
2018-11-29 18:08:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667799  77 58451 65339437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:08:59 [DEBUG   ] Got command RPT from MCS: ref #667800
2018-11-29 18:08:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667800  12 58451 65339629 A  ERRORB—™š'
2018-11-29 18:09:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:09:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:09:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:09:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:09:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:09:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:09:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:09:57 [DEBUG   ] Finished updating board flags in 1.750 seconds
2018-11-29 18:10:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:10:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:10:49 [DEBUG   ] Got command RPT from MCS: ref #667801
2018-11-29 18:10:49 [DEBUG   ] summary = ERROR
2018-11-29 18:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667801  13 58451 65449757 A  ERRORERROR'
2018-11-29 18:10:49 [DEBUG   ] Got command RPT from MCS: ref #667802
2018-11-29 18:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667802  77 58451 65449758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:10:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:10:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:10:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:10:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:10:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:10:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:10:56 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-29 18:11:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:11:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:11:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:11:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:11:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:11:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:11:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:11:57 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-29 18:12:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:12:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:12:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:12:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:12:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:12:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:12:56 [WARNING ] (13, 1, 'bot')
2018-11-29 18:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:12:56 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-29 18:13:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 18:13:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:13:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 18:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:13:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:13:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:13:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:13:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:13:57 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-11-29 18:13:58 [DEBUG   ] Got command RPT from MCS: ref #667824
2018-11-29 18:13:58 [DEBUG   ] summary = ERROR
2018-11-29 18:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667824  13 58451 65638917 A  ERRORERROR'
2018-11-29 18:13:59 [DEBUG   ] Got command RPT from MCS: ref #667825
2018-11-29 18:13:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667825  77 58451 65639121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:13:59 [DEBUG   ] Got command RPT from MCS: ref #667826
2018-11-29 18:13:59 [DEBUG   ] summary = ERROR
2018-11-29 18:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667826  13 58451 65639313 A  ERRORERROR'
2018-11-29 18:13:59 [DEBUG   ] Got command RPT from MCS: ref #667828
2018-11-29 18:13:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667828  77 58451 65639517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:13:59 [DEBUG   ] Got command RPT from MCS: ref #667829
2018-11-29 18:13:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667829  12 58451 65639721 A  ERRORB—™š'
2018-11-29 18:14:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:14:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:14:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:14:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:14:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:14:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:14:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:14:57 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-29 18:15:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:15:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:15:49 [DEBUG   ] Got command RPT from MCS: ref #667838
2018-11-29 18:15:49 [DEBUG   ] summary = ERROR
2018-11-29 18:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667838  13 58451 65749757 A  ERRORERROR'
2018-11-29 18:15:49 [DEBUG   ] Got command RPT from MCS: ref #667839
2018-11-29 18:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667839  77 58451 65749758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:15:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:15:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:15:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:15:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:15:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:15:57 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-11-29 18:16:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:16:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:16:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:16:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:16:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:16:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:16:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:16:58 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-29 18:17:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:17:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:17:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:17:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 18:17:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:17:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:17:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:17:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:17:57 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-29 18:18:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:18:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:18:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:18:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:18:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:18:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:18:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:18:58 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-29 18:18:59 [DEBUG   ] Got command RPT from MCS: ref #667859
2018-11-29 18:18:59 [DEBUG   ] summary = ERROR
2018-11-29 18:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667859  13 58451 65939005 A  ERRORERROR'
2018-11-29 18:18:59 [DEBUG   ] Got command RPT from MCS: ref #667860
2018-11-29 18:18:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667860  77 58451 65939209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:18:59 [DEBUG   ] Got command RPT from MCS: ref #667861
2018-11-29 18:18:59 [DEBUG   ] summary = ERROR
2018-11-29 18:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667861  13 58451 65939401 A  ERRORERROR'
2018-11-29 18:18:59 [DEBUG   ] Got command RPT from MCS: ref #667862
2018-11-29 18:18:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667862  77 58451 65939605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:18:59 [DEBUG   ] Got command RPT from MCS: ref #667863
2018-11-29 18:18:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667863  12 58451 65939809 A  ERRORB˜™š'
2018-11-29 18:19:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:19:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:19:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:19:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:19:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:19:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:19:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:19:57 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-11-29 18:20:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:20:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:20:49 [DEBUG   ] Got command RPT from MCS: ref #667868
2018-11-29 18:20:49 [DEBUG   ] summary = ERROR
2018-11-29 18:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667868  13 58451 66049761 A  ERRORERROR'
2018-11-29 18:20:49 [DEBUG   ] Got command RPT from MCS: ref #667869
2018-11-29 18:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667869  77 58451 66049762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:20:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:20:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:20:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:20:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:20:57 [WARNING ] (13, 1, 'bot')
2018-11-29 18:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:20:57 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-29 18:21:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:21:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:21:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:21:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:21:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:21:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:21:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:21:58 [DEBUG   ] Finished updating board flags in 1.554 seconds
2018-11-29 18:22:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:22:33 [DEBUG   ] Got command BAM from MCS: ref #667889
2018-11-29 18:22:33 [INFO    ] Finished processing BAM request
2018-11-29 18:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667889   8 58451 66153029 A  ERROR'
2018-11-29 18:22:33 [DEBUG   ] Got command BAM from MCS: ref #667890
2018-11-29 18:22:33 [INFO    ] Finished processing BAM request
2018-11-29 18:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667890   8 58451 66153033 A  ERROR'
2018-11-29 18:22:33 [DEBUG   ] Got command DRX from MCS: ref #667891
2018-11-29 18:22:33 [INFO    ] sending drx command to lwa16
2018-11-29 18:22:33 [DEBUG   ] run_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 9']
2018-11-29 18:22:33 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 18:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   667891   8 58451 66153097 A  ERROR'
2018-11-29 18:22:33 [DEBUG   ] Got command DRX from MCS: ref #667892
2018-11-29 18:22:33 [INFO    ] sending drx command to lwa34
2018-11-29 18:22:33 [DEBUG   ] run_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 9']
2018-11-29 18:22:33 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 18:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   667892   8 58451 66153101 A  ERROR'
2018-11-29 18:22:33 [DEBUG   ] Got command DRX from MCS: ref #667894
2018-11-29 18:22:33 [INFO    ] sending drx command to lwa34
2018-11-29 18:22:33 [DEBUG   ] run_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 9']
2018-11-29 18:22:33 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 18:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   667894   8 58451 66153105 A  ERROR'
2018-11-29 18:22:33 [DEBUG   ] Got command DRX from MCS: ref #667893
2018-11-29 18:22:33 [INFO    ] sending drx command to lwa16
2018-11-29 18:22:33 [DEBUG   ] run_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 9']
2018-11-29 18:22:33 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 18:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   667893   8 58451 66153109 A  ERROR'
2018-11-29 18:22:33 [INFO    ] Finished starting DRX
2018-11-29 18:22:33 [INFO    ] Finished starting DRX
2018-11-29 18:22:33 [INFO    ] Finished starting DRX
2018-11-29 18:22:33 [INFO    ] Finished starting DRX
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:22:33 [DEBUG   ] spawn_process: at 2018-11-29 18:22:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:22:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:22:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:22:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:22:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:22:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:22:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:22:58 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-11-29 18:22:59 [DEBUG   ] Got command BAM from MCS: ref #667898
2018-11-29 18:22:59 [INFO    ] Finished processing BAM request
2018-11-29 18:22:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:22:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667898   8 58451 66179025 A  ERROR'
2018-11-29 18:22:59 [DEBUG   ] Got command BAM from MCS: ref #667897
2018-11-29 18:22:59 [INFO    ] Finished processing BAM request
2018-11-29 18:22:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:22:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667897   8 58451 66179029 A  ERROR'
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:22:59 [DEBUG   ] spawn_process: at 2018-11-29 18:22:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:23:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:23:25 [DEBUG   ] Got command BAM from MCS: ref #667904
2018-11-29 18:23:25 [INFO    ] Finished processing BAM request
2018-11-29 18:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667904   8 58451 66205029 A  ERROR'
2018-11-29 18:23:25 [DEBUG   ] Got command BAM from MCS: ref #667903
2018-11-29 18:23:25 [INFO    ] Finished processing BAM request
2018-11-29 18:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667903   8 58451 66205033 A  ERROR'
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:23:25 [DEBUG   ] spawn_process: at 2018-11-29 18:23:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:23:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:23:51 [DEBUG   ] Got command BAM from MCS: ref #667908
2018-11-29 18:23:51 [INFO    ] Finished processing BAM request
2018-11-29 18:23:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667908   8 58451 66231033 A  ERROR'
2018-11-29 18:23:51 [DEBUG   ] Got command BAM from MCS: ref #667907
2018-11-29 18:23:51 [INFO    ] Finished processing BAM request
2018-11-29 18:23:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667907   8 58451 66231041 A  ERROR'
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:23:51 [DEBUG   ] spawn_process: at 2018-11-29 18:23:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:23:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 18:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:23:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:23:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:23:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:23:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:23:58 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-29 18:23:59 [DEBUG   ] Got command RPT from MCS: ref #667909
2018-11-29 18:23:59 [DEBUG   ] summary = ERROR
2018-11-29 18:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667909  13 58451 66239089 A  ERRORERROR'
2018-11-29 18:23:59 [DEBUG   ] Got command RPT from MCS: ref #667910
2018-11-29 18:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667910  77 58451 66239293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:23:59 [DEBUG   ] Got command RPT from MCS: ref #667911
2018-11-29 18:23:59 [DEBUG   ] summary = ERROR
2018-11-29 18:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667911  13 58451 66239497 A  ERRORERROR'
2018-11-29 18:23:59 [DEBUG   ] Got command RPT from MCS: ref #667913
2018-11-29 18:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667913  77 58451 66239689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:23:59 [DEBUG   ] Got command RPT from MCS: ref #667914
2018-11-29 18:23:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667914  12 58451 66239893 A  ERRORBŸff'
2018-11-29 18:24:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:24:17 [DEBUG   ] Got command BAM from MCS: ref #667920
2018-11-29 18:24:17 [INFO    ] Finished processing BAM request
2018-11-29 18:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667920   8 58451 66257033 A  ERROR'
2018-11-29 18:24:17 [DEBUG   ] Got command BAM from MCS: ref #667919
2018-11-29 18:24:17 [INFO    ] Finished processing BAM request
2018-11-29 18:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667919   8 58451 66257037 A  ERROR'
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:24:17 [DEBUG   ] spawn_process: at 2018-11-29 18:24:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:24:36 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-29 18:24:43 [DEBUG   ] Got command BAM from MCS: ref #667922
2018-11-29 18:24:43 [INFO    ] Finished processing BAM request
2018-11-29 18:24:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667922   8 58451 66283033 A  ERROR'
2018-11-29 18:24:43 [DEBUG   ] Got command BAM from MCS: ref #667921
2018-11-29 18:24:43 [INFO    ] Finished processing BAM request
2018-11-29 18:24:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667921   8 58451 66283037 A  ERROR'
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:24:43 [DEBUG   ] spawn_process: at 2018-11-29 18:24:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:24:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:24:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:24:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:24:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:24:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:24:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:24:58 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-29 18:25:08 [DEBUG   ] Got command BAM from MCS: ref #667923
2018-11-29 18:25:08 [INFO    ] Finished processing BAM request
2018-11-29 18:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667923   8 58451 66308033 A  ERROR'
2018-11-29 18:25:08 [DEBUG   ] Got command BAM from MCS: ref #667924
2018-11-29 18:25:08 [INFO    ] Finished processing BAM request
2018-11-29 18:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667924   8 58451 66308037 A  ERROR'
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:25:08 [DEBUG   ] spawn_process: at 2018-11-29 18:25:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:25:16 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-29 18:25:33 [DEBUG   ] Got command BAM from MCS: ref #667925
2018-11-29 18:25:33 [INFO    ] Finished processing BAM request
2018-11-29 18:25:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667925   8 58451 66333033 A  ERROR'
2018-11-29 18:25:33 [DEBUG   ] Got command BAM from MCS: ref #667926
2018-11-29 18:25:33 [INFO    ] Finished processing BAM request
2018-11-29 18:25:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667926   8 58451 66333037 A  ERROR'
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:25:33 [DEBUG   ] spawn_process: at 2018-11-29 18:25:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:25:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:25:49 [DEBUG   ] Got command RPT from MCS: ref #667927
2018-11-29 18:25:49 [DEBUG   ] summary = ERROR
2018-11-29 18:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667927  13 58451 66349761 A  ERRORERROR'
2018-11-29 18:25:49 [DEBUG   ] Got command RPT from MCS: ref #667928
2018-11-29 18:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667928  77 58451 66349762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:25:56 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-29 18:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:25:58 [DEBUG   ] Got command BAM from MCS: ref #667944
2018-11-29 18:25:58 [INFO    ] Finished processing BAM request
2018-11-29 18:25:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667944   8 58451 66358029 A  ERROR'
2018-11-29 18:25:58 [DEBUG   ] Got command BAM from MCS: ref #667945
2018-11-29 18:25:58 [INFO    ] Finished processing BAM request
2018-11-29 18:25:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667945   8 58451 66358033 A  ERROR'
2018-11-29 18:25:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:25:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:25:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:25:58 [DEBUG   ] spawn_process: at 2018-11-29 18:25:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:26:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:26:23 [DEBUG   ] Got command BAM from MCS: ref #667951
2018-11-29 18:26:23 [INFO    ] Finished processing BAM request
2018-11-29 18:26:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667951   8 58451 66383025 A  ERROR'
2018-11-29 18:26:23 [DEBUG   ] Got command BAM from MCS: ref #667950
2018-11-29 18:26:23 [INFO    ] Finished processing BAM request
2018-11-29 18:26:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667950   8 58451 66383029 A  ERROR'
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:26:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:26:23 [DEBUG   ] spawn_process: at 2018-11-29 18:26:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:26:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:26:48 [DEBUG   ] Got command BAM from MCS: ref #667953
2018-11-29 18:26:48 [INFO    ] Finished processing BAM request
2018-11-29 18:26:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667953   8 58451 66408025 A  ERROR'
2018-11-29 18:26:48 [DEBUG   ] Got command BAM from MCS: ref #667952
2018-11-29 18:26:48 [INFO    ] Finished processing BAM request
2018-11-29 18:26:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667952   8 58451 66408029 A  ERROR'
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:26:48 [DEBUG   ] spawn_process: at 2018-11-29 18:26:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:26:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:26:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:26:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:26:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:26:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:26:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:26:58 [DEBUG   ] Finished updating board flags in 1.058 seconds
2018-11-29 18:27:13 [DEBUG   ] Got command BAM from MCS: ref #667955
2018-11-29 18:27:13 [INFO    ] Finished processing BAM request
2018-11-29 18:27:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667955   8 58451 66433029 A  ERROR'
2018-11-29 18:27:13 [DEBUG   ] Got command BAM from MCS: ref #667954
2018-11-29 18:27:13 [INFO    ] Finished processing BAM request
2018-11-29 18:27:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667954   8 58451 66433033 A  ERROR'
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:27:13 [DEBUG   ] spawn_process: at 2018-11-29 18:27:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:27:16 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-29 18:27:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-29 18:27:38 [DEBUG   ] Got command BAM from MCS: ref #667956
2018-11-29 18:27:38 [INFO    ] Finished processing BAM request
2018-11-29 18:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667956   8 58451 66458025 A  ERROR'
2018-11-29 18:27:38 [DEBUG   ] Got command BAM from MCS: ref #667957
2018-11-29 18:27:38 [INFO    ] Finished processing BAM request
2018-11-29 18:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667957   8 58451 66458029 A  ERROR'
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:27:38 [DEBUG   ] spawn_process: at 2018-11-29 18:27:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:27:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 18:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:27:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:27:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:27:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:27:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:27:59 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-29 18:28:03 [DEBUG   ] Got command BAM from MCS: ref #667958
2018-11-29 18:28:03 [INFO    ] Finished processing BAM request
2018-11-29 18:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667958   8 58451 66483025 A  ERROR'
2018-11-29 18:28:03 [DEBUG   ] Got command BAM from MCS: ref #667959
2018-11-29 18:28:03 [INFO    ] Finished processing BAM request
2018-11-29 18:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667959   8 58451 66483029 A  ERROR'
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:28:03 [DEBUG   ] spawn_process: at 2018-11-29 18:28:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:28:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:28:28 [DEBUG   ] Got command BAM from MCS: ref #667960
2018-11-29 18:28:28 [INFO    ] Finished processing BAM request
2018-11-29 18:28:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667960   8 58451 66508033 A  ERROR'
2018-11-29 18:28:28 [DEBUG   ] Got command BAM from MCS: ref #667961
2018-11-29 18:28:28 [INFO    ] Finished processing BAM request
2018-11-29 18:28:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667961   8 58451 66508041 A  ERROR'
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:28:28 [DEBUG   ] spawn_process: at 2018-11-29 18:28:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:28:35 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-11-29 18:28:53 [DEBUG   ] Got command BAM from MCS: ref #667963
2018-11-29 18:28:53 [INFO    ] Finished processing BAM request
2018-11-29 18:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667963   8 58451 66533029 A  ERROR'
2018-11-29 18:28:53 [DEBUG   ] Got command BAM from MCS: ref #667962
2018-11-29 18:28:53 [INFO    ] Finished processing BAM request
2018-11-29 18:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667962   8 58451 66533033 A  ERROR'
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:28:53 [DEBUG   ] spawn_process: at 2018-11-29 18:28:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:28:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:28:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 18:28:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:28:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:28:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:28:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:28:58 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-29 18:28:59 [DEBUG   ] Got command RPT from MCS: ref #667964
2018-11-29 18:28:59 [DEBUG   ] summary = ERROR
2018-11-29 18:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667964  13 58451 66539177 A  ERRORERROR'
2018-11-29 18:28:59 [DEBUG   ] Got command RPT from MCS: ref #667965
2018-11-29 18:28:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667965  77 58451 66539369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:28:59 [DEBUG   ] Got command RPT from MCS: ref #667966
2018-11-29 18:28:59 [DEBUG   ] summary = ERROR
2018-11-29 18:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667966  13 58451 66539573 A  ERRORERROR'
2018-11-29 18:28:59 [DEBUG   ] Got command RPT from MCS: ref #667967
2018-11-29 18:28:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667967  77 58451 66539777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:28:59 [DEBUG   ] Got command RPT from MCS: ref #667968
2018-11-29 18:28:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667968  12 58451 66539969 A  ERRORB¢ff'
2018-11-29 18:29:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-29 18:29:18 [DEBUG   ] Got command BAM from MCS: ref #667974
2018-11-29 18:29:18 [INFO    ] Finished processing BAM request
2018-11-29 18:29:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667974   8 58451 66558033 A  ERROR'
2018-11-29 18:29:18 [DEBUG   ] Got command BAM from MCS: ref #667973
2018-11-29 18:29:18 [INFO    ] Finished processing BAM request
2018-11-29 18:29:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667973   8 58451 66558037 A  ERROR'
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:29:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:29:18 [DEBUG   ] spawn_process: at 2018-11-29 18:29:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:29:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:29:43 [DEBUG   ] Got command BAM from MCS: ref #667975
2018-11-29 18:29:43 [INFO    ] Finished processing BAM request
2018-11-29 18:29:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667975   8 58451 66583025 A  ERROR'
2018-11-29 18:29:43 [DEBUG   ] Got command BAM from MCS: ref #667976
2018-11-29 18:29:43 [INFO    ] Finished processing BAM request
2018-11-29 18:29:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667976   8 58451 66583029 A  ERROR'
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:29:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:29:43 [DEBUG   ] spawn_process: at 2018-11-29 18:29:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:29:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:29:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:29:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:29:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:29:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:29:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:29:58 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-29 18:30:08 [DEBUG   ] Got command BAM from MCS: ref #667977
2018-11-29 18:30:08 [INFO    ] Finished processing BAM request
2018-11-29 18:30:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667977   8 58451 66608029 A  ERROR'
2018-11-29 18:30:08 [DEBUG   ] Got command BAM from MCS: ref #667978
2018-11-29 18:30:08 [INFO    ] Finished processing BAM request
2018-11-29 18:30:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667978   8 58451 66608033 A  ERROR'
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:30:08 [DEBUG   ] spawn_process: at 2018-11-29 18:30:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:30:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:30:33 [DEBUG   ] Got command BAM from MCS: ref #667980
2018-11-29 18:30:33 [INFO    ] Finished processing BAM request
2018-11-29 18:30:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667980   8 58451 66633033 A  ERROR'
2018-11-29 18:30:33 [DEBUG   ] Got command BAM from MCS: ref #667979
2018-11-29 18:30:33 [INFO    ] Finished processing BAM request
2018-11-29 18:30:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667979   8 58451 66633037 A  ERROR'
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:30:33 [DEBUG   ] spawn_process: at 2018-11-29 18:30:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:30:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:30:49 [DEBUG   ] Got command RPT from MCS: ref #667981
2018-11-29 18:30:49 [DEBUG   ] summary = ERROR
2018-11-29 18:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667981  13 58451 66649765 A  ERRORERROR'
2018-11-29 18:30:49 [DEBUG   ] Got command RPT from MCS: ref #667982
2018-11-29 18:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   667982  77 58451 66649766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:30:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-29 18:30:57 [DEBUG   ] Got command BAM from MCS: ref #667999
2018-11-29 18:30:57 [INFO    ] Finished processing BAM request
2018-11-29 18:30:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667999   8 58451 66657029 A  ERROR'
2018-11-29 18:30:57 [DEBUG   ] Got command BAM from MCS: ref #667998
2018-11-29 18:30:57 [INFO    ] Finished processing BAM request
2018-11-29 18:30:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   667998   8 58451 66657033 A  ERROR'
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:30:57 [DEBUG   ] spawn_process: at 2018-11-29 18:30:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:30:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:30:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:30:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:30:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:30:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:30:58 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-29 18:31:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:31:21 [DEBUG   ] Got command BAM from MCS: ref #668000
2018-11-29 18:31:21 [INFO    ] Finished processing BAM request
2018-11-29 18:31:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668000   8 58451 66681025 A  ERROR'
2018-11-29 18:31:21 [DEBUG   ] Got command BAM from MCS: ref #668001
2018-11-29 18:31:21 [INFO    ] Finished processing BAM request
2018-11-29 18:31:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668001   8 58451 66681029 A  ERROR'
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:31:21 [DEBUG   ] spawn_process: at 2018-11-29 18:31:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:31:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:31:45 [DEBUG   ] Got command BAM from MCS: ref #668003
2018-11-29 18:31:45 [INFO    ] Finished processing BAM request
2018-11-29 18:31:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668003   8 58451 66705029 A  ERROR'
2018-11-29 18:31:45 [DEBUG   ] Got command BAM from MCS: ref #668002
2018-11-29 18:31:45 [INFO    ] Finished processing BAM request
2018-11-29 18:31:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668002   8 58451 66705033 A  ERROR'
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:31:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:31:45 [DEBUG   ] spawn_process: at 2018-11-29 18:31:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:31:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 18:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:31:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:31:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:31:58 [DEBUG   ] Finished updating board flags in 1.031 seconds
2018-11-29 18:32:09 [DEBUG   ] Got command BAM from MCS: ref #668004
2018-11-29 18:32:09 [INFO    ] Finished processing BAM request
2018-11-29 18:32:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668004   8 58451 66729029 A  ERROR'
2018-11-29 18:32:09 [DEBUG   ] Got command BAM from MCS: ref #668005
2018-11-29 18:32:09 [INFO    ] Finished processing BAM request
2018-11-29 18:32:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668005   8 58451 66729033 A  ERROR'
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:32:09 [DEBUG   ] spawn_process: at 2018-11-29 18:32:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:32:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-29 18:32:33 [DEBUG   ] Got command BAM from MCS: ref #668010
2018-11-29 18:32:33 [INFO    ] Finished processing BAM request
2018-11-29 18:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668010   8 58451 66753029 A  ERROR'
2018-11-29 18:32:33 [DEBUG   ] Got command BAM from MCS: ref #668011
2018-11-29 18:32:33 [INFO    ] Finished processing BAM request
2018-11-29 18:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668011   8 58451 66753033 A  ERROR'
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:32:33 [DEBUG   ] spawn_process: at 2018-11-29 18:32:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:32:57 [DEBUG   ] Got command BAM from MCS: ref #668012
2018-11-29 18:32:57 [INFO    ] Finished processing BAM request
2018-11-29 18:32:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:32:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668012   8 58451 66777033 A  ERROR'
2018-11-29 18:32:57 [DEBUG   ] Got command BAM from MCS: ref #668013
2018-11-29 18:32:57 [INFO    ] Finished processing BAM request
2018-11-29 18:32:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:32:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668013   8 58451 66777037 A  ERROR'
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:32:57 [DEBUG   ] spawn_process: at 2018-11-29 18:32:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:32:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 18:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 18:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 18:32:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:32:58 [WARNING ] (13, 1, 'bot')
2018-11-29 18:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:32:58 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-11-29 18:33:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:33:21 [DEBUG   ] Got command BAM from MCS: ref #668014
2018-11-29 18:33:21 [INFO    ] Finished processing BAM request
2018-11-29 18:33:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668014   8 58451 66801029 A  ERROR'
2018-11-29 18:33:21 [DEBUG   ] Got command BAM from MCS: ref #668015
2018-11-29 18:33:21 [INFO    ] Finished processing BAM request
2018-11-29 18:33:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668015   8 58451 66801033 A  ERROR'
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:33:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:33:21 [DEBUG   ] spawn_process: at 2018-11-29 18:33:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:33:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:33:45 [DEBUG   ] Got command BAM from MCS: ref #668019
2018-11-29 18:33:45 [INFO    ] Finished processing BAM request
2018-11-29 18:33:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668019   8 58451 66825033 A  ERROR'
2018-11-29 18:33:45 [DEBUG   ] Got command BAM from MCS: ref #668018
2018-11-29 18:33:45 [INFO    ] Finished processing BAM request
2018-11-29 18:33:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668018   8 58451 66825037 A  ERROR'
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:33:45 [DEBUG   ] spawn_process: at 2018-11-29 18:33:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:33:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 18:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:33:59 [DEBUG   ] Got command RPT from MCS: ref #668020
2018-11-29 18:33:59 [DEBUG   ] summary = ERROR
2018-11-29 18:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668020  13 58451 66839261 A  ERRORERROR'
2018-11-29 18:33:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:33:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:33:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:33:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:33:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:33:59 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-11-29 18:33:59 [DEBUG   ] Got command RPT from MCS: ref #668021
2018-11-29 18:33:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668021  77 58451 66839453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:33:59 [DEBUG   ] Got command RPT from MCS: ref #668022
2018-11-29 18:33:59 [DEBUG   ] summary = ERROR
2018-11-29 18:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668022  13 58451 66839657 A  ERRORERROR'
2018-11-29 18:33:59 [DEBUG   ] Got command RPT from MCS: ref #668024
2018-11-29 18:33:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668024  77 58451 66839861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:34:00 [DEBUG   ] Got command RPT from MCS: ref #668026
2018-11-29 18:34:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668026  12 58451 66840065 A  ERRORB¢ff'
2018-11-29 18:34:09 [DEBUG   ] Got command BAM from MCS: ref #668031
2018-11-29 18:34:09 [INFO    ] Finished processing BAM request
2018-11-29 18:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668031   8 58451 66849033 A  ERROR'
2018-11-29 18:34:09 [DEBUG   ] Got command BAM from MCS: ref #668030
2018-11-29 18:34:09 [INFO    ] Finished processing BAM request
2018-11-29 18:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668030   8 58451 66849037 A  ERROR'
2018-11-29 18:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:34:09 [DEBUG   ] spawn_process: at 2018-11-29 18:34:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:34:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:34:10 [DEBUG   ] spawn_process: at 2018-11-29 18:34:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:34:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 18:34:33 [DEBUG   ] Got command BAM from MCS: ref #668033
2018-11-29 18:34:33 [INFO    ] Finished processing BAM request
2018-11-29 18:34:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668033   8 58451 66873029 A  ERROR'
2018-11-29 18:34:33 [DEBUG   ] Got command BAM from MCS: ref #668032
2018-11-29 18:34:33 [INFO    ] Finished processing BAM request
2018-11-29 18:34:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668032   8 58451 66873033 A  ERROR'
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:34:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:34:33 [DEBUG   ] spawn_process: at 2018-11-29 18:34:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:34:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:34:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:34:57 [DEBUG   ] Got command BAM from MCS: ref #668034
2018-11-29 18:34:57 [INFO    ] Finished processing BAM request
2018-11-29 18:34:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668034   8 58451 66897029 A  ERROR'
2018-11-29 18:34:57 [DEBUG   ] Got command BAM from MCS: ref #668035
2018-11-29 18:34:57 [INFO    ] Finished processing BAM request
2018-11-29 18:34:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668035   8 58451 66897033 A  ERROR'
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:34:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:34:57 [DEBUG   ] spawn_process: at 2018-11-29 18:34:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 18:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 18:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:34:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 18:34:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:34:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:34:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:34:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:34:59 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-29 18:35:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 18:35:21 [DEBUG   ] Got command BAM from MCS: ref #668041
2018-11-29 18:35:21 [INFO    ] Finished processing BAM request
2018-11-29 18:35:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668041   8 58451 66921029 A  ERROR'
2018-11-29 18:35:21 [DEBUG   ] Got command BAM from MCS: ref #668040
2018-11-29 18:35:21 [INFO    ] Finished processing BAM request
2018-11-29 18:35:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:35:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668040   8 58451 66921033 A  ERROR'
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:35:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:35:21 [DEBUG   ] spawn_process: at 2018-11-29 18:35:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:35:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:35:45 [DEBUG   ] Got command BAM from MCS: ref #668043
2018-11-29 18:35:45 [INFO    ] Finished processing BAM request
2018-11-29 18:35:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668043   8 58451 66945029 A  ERROR'
2018-11-29 18:35:45 [DEBUG   ] Got command BAM from MCS: ref #668042
2018-11-29 18:35:45 [INFO    ] Finished processing BAM request
2018-11-29 18:35:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668042   8 58451 66945033 A  ERROR'
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:35:45 [DEBUG   ] spawn_process: at 2018-11-29 18:35:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:35:49 [DEBUG   ] Got command RPT from MCS: ref #668044
2018-11-29 18:35:49 [DEBUG   ] summary = ERROR
2018-11-29 18:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668044  13 58451 66949765 A  ERRORERROR'
2018-11-29 18:35:49 [DEBUG   ] Got command RPT from MCS: ref #668045
2018-11-29 18:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668045  77 58451 66949766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:35:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 18:35:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:35:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:35:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:35:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:35:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:35:59 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-29 18:36:09 [DEBUG   ] Got command BAM from MCS: ref #668061
2018-11-29 18:36:09 [INFO    ] Finished processing BAM request
2018-11-29 18:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668061   8 58451 66969025 A  ERROR'
2018-11-29 18:36:09 [DEBUG   ] Got command BAM from MCS: ref #668062
2018-11-29 18:36:09 [INFO    ] Finished processing BAM request
2018-11-29 18:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668062   8 58451 66969029 A  ERROR'
2018-11-29 18:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:36:09 [DEBUG   ] spawn_process: at 2018-11-29 18:36:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:36:10 [DEBUG   ] spawn_process: at 2018-11-29 18:36:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:36:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:36:33 [DEBUG   ] Got command BAM from MCS: ref #668063
2018-11-29 18:36:33 [INFO    ] Finished processing BAM request
2018-11-29 18:36:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668063   8 58451 66993029 A  ERROR'
2018-11-29 18:36:33 [DEBUG   ] Got command BAM from MCS: ref #668064
2018-11-29 18:36:33 [INFO    ] Finished processing BAM request
2018-11-29 18:36:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668064   8 58451 66993033 A  ERROR'
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:36:33 [DEBUG   ] spawn_process: at 2018-11-29 18:36:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:36:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:36:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:36:57 [DEBUG   ] Got command BAM from MCS: ref #668066
2018-11-29 18:36:57 [INFO    ] Finished processing BAM request
2018-11-29 18:36:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668066   8 58451 67017025 A  ERROR'
2018-11-29 18:36:57 [DEBUG   ] Got command BAM from MCS: ref #668065
2018-11-29 18:36:57 [INFO    ] Finished processing BAM request
2018-11-29 18:36:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668065   8 58451 67017029 A  ERROR'
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:36:57 [DEBUG   ] spawn_process: at 2018-11-29 18:36:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 18:36:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:36:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:36:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:36:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:36:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:36:59 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-29 18:37:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:37:21 [DEBUG   ] Got command BAM from MCS: ref #668067
2018-11-29 18:37:21 [INFO    ] Finished processing BAM request
2018-11-29 18:37:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668067   8 58451 67041025 A  ERROR'
2018-11-29 18:37:21 [DEBUG   ] Got command BAM from MCS: ref #668068
2018-11-29 18:37:21 [INFO    ] Finished processing BAM request
2018-11-29 18:37:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668068   8 58451 67041029 A  ERROR'
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:37:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:37:21 [DEBUG   ] spawn_process: at 2018-11-29 18:37:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:37:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:37:44 [DEBUG   ] Got command BAM from MCS: ref #668070
2018-11-29 18:37:44 [INFO    ] Finished processing BAM request
2018-11-29 18:37:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:37:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668070   8 58451 67064033 A  ERROR'
2018-11-29 18:37:44 [DEBUG   ] Got command BAM from MCS: ref #668069
2018-11-29 18:37:44 [INFO    ] Finished processing BAM request
2018-11-29 18:37:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:37:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668069   8 58451 67064037 A  ERROR'
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:37:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:37:44 [DEBUG   ] spawn_process: at 2018-11-29 18:37:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:37:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:38:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:38:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:38:00 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-11-29 18:38:07 [DEBUG   ] Got command BAM from MCS: ref #668072
2018-11-29 18:38:07 [INFO    ] Finished processing BAM request
2018-11-29 18:38:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668072   8 58451 67087033 A  ERROR'
2018-11-29 18:38:07 [DEBUG   ] Got command BAM from MCS: ref #668071
2018-11-29 18:38:07 [INFO    ] Finished processing BAM request
2018-11-29 18:38:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668071   8 58451 67087037 A  ERROR'
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:38:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:38:07 [DEBUG   ] spawn_process: at 2018-11-29 18:38:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:38:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:38:30 [DEBUG   ] Got command BAM from MCS: ref #668077
2018-11-29 18:38:30 [INFO    ] Finished processing BAM request
2018-11-29 18:38:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668077   8 58451 67110033 A  ERROR'
2018-11-29 18:38:30 [DEBUG   ] Got command BAM from MCS: ref #668078
2018-11-29 18:38:30 [INFO    ] Finished processing BAM request
2018-11-29 18:38:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668078   8 58451 67110037 A  ERROR'
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:38:30 [DEBUG   ] spawn_process: at 2018-11-29 18:38:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:38:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:38:53 [DEBUG   ] Got command BAM from MCS: ref #668079
2018-11-29 18:38:53 [INFO    ] Finished processing BAM request
2018-11-29 18:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668079   8 58451 67133029 A  ERROR'
2018-11-29 18:38:53 [DEBUG   ] Got command BAM from MCS: ref #668080
2018-11-29 18:38:53 [INFO    ] Finished processing BAM request
2018-11-29 18:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668080   8 58451 67133033 A  ERROR'
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:38:53 [DEBUG   ] spawn_process: at 2018-11-29 18:38:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:38:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:38:59 [DEBUG   ] Got command RPT from MCS: ref #668081
2018-11-29 18:38:59 [DEBUG   ] summary = ERROR
2018-11-29 18:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668081  13 58451 67139341 A  ERRORERROR'
2018-11-29 18:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:38:59 [DEBUG   ] Got command RPT from MCS: ref #668082
2018-11-29 18:38:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668082  77 58451 67139545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:38:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:38:59 [DEBUG   ] Got command RPT from MCS: ref #668083
2018-11-29 18:38:59 [DEBUG   ] summary = ERROR
2018-11-29 18:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668083  13 58451 67139741 A  ERRORERROR'
2018-11-29 18:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:38:59 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-29 18:38:59 [DEBUG   ] Got command RPT from MCS: ref #668084
2018-11-29 18:38:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668084  77 58451 67139945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:39:00 [DEBUG   ] Got command RPT from MCS: ref #668085
2018-11-29 18:39:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668085  12 58451 67140149 A  ERRORB¢ff'
2018-11-29 18:39:16 [DEBUG   ] Got command BAM from MCS: ref #668087
2018-11-29 18:39:16 [INFO    ] Finished processing BAM request
2018-11-29 18:39:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668087   8 58451 67156029 A  ERROR'
2018-11-29 18:39:16 [DEBUG   ] Got command BAM from MCS: ref #668086
2018-11-29 18:39:16 [INFO    ] Finished processing BAM request
2018-11-29 18:39:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668086   8 58451 67156033 A  ERROR'
2018-11-29 18:39:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:39:16 [DEBUG   ] spawn_process: at 2018-11-29 18:39:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:39:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:39:39 [DEBUG   ] Got command BAM from MCS: ref #668088
2018-11-29 18:39:39 [INFO    ] Finished processing BAM request
2018-11-29 18:39:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668088   8 58451 67179029 A  ERROR'
2018-11-29 18:39:39 [DEBUG   ] Got command BAM from MCS: ref #668089
2018-11-29 18:39:39 [INFO    ] Finished processing BAM request
2018-11-29 18:39:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668089   8 58451 67179033 A  ERROR'
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:39:39 [DEBUG   ] spawn_process: at 2018-11-29 18:39:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:39:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:39:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:39:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:39:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:39:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:39:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:39:59 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-29 18:40:02 [DEBUG   ] Got command BAM from MCS: ref #668091
2018-11-29 18:40:02 [INFO    ] Finished processing BAM request
2018-11-29 18:40:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668091   8 58451 67202029 A  ERROR'
2018-11-29 18:40:02 [DEBUG   ] Got command BAM from MCS: ref #668090
2018-11-29 18:40:02 [INFO    ] Finished processing BAM request
2018-11-29 18:40:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668090   8 58451 67202033 A  ERROR'
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:40:02 [DEBUG   ] spawn_process: at 2018-11-29 18:40:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:40:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:40:25 [DEBUG   ] Got command BAM from MCS: ref #668093
2018-11-29 18:40:25 [INFO    ] Finished processing BAM request
2018-11-29 18:40:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668093   8 58451 67225033 A  ERROR'
2018-11-29 18:40:25 [DEBUG   ] Got command BAM from MCS: ref #668092
2018-11-29 18:40:25 [INFO    ] Finished processing BAM request
2018-11-29 18:40:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668092   8 58451 67225037 A  ERROR'
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:40:25 [DEBUG   ] spawn_process: at 2018-11-29 18:40:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:40:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:40:48 [DEBUG   ] Got command BAM from MCS: ref #668095
2018-11-29 18:40:48 [INFO    ] Finished processing BAM request
2018-11-29 18:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668095   8 58451 67248029 A  ERROR'
2018-11-29 18:40:48 [DEBUG   ] Got command BAM from MCS: ref #668094
2018-11-29 18:40:48 [INFO    ] Finished processing BAM request
2018-11-29 18:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668094   8 58451 67248033 A  ERROR'
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:40:48 [DEBUG   ] spawn_process: at 2018-11-29 18:40:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:40:49 [DEBUG   ] Got command RPT from MCS: ref #668096
2018-11-29 18:40:49 [DEBUG   ] summary = ERROR
2018-11-29 18:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668096  13 58451 67249761 A  ERRORERROR'
2018-11-29 18:40:49 [DEBUG   ] Got command RPT from MCS: ref #668097
2018-11-29 18:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668097  77 58451 67249762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:40:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:40:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:40:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:40:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:40:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:40:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:40:59 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-29 18:41:11 [DEBUG   ] Got command BAM from MCS: ref #668113
2018-11-29 18:41:11 [INFO    ] Finished processing BAM request
2018-11-29 18:41:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668113   8 58451 67271029 A  ERROR'
2018-11-29 18:41:11 [DEBUG   ] Got command BAM from MCS: ref #668114
2018-11-29 18:41:11 [INFO    ] Finished processing BAM request
2018-11-29 18:41:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668114   8 58451 67271033 A  ERROR'
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:41:11 [DEBUG   ] spawn_process: at 2018-11-29 18:41:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:41:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-29 18:41:34 [DEBUG   ] Got command BAM from MCS: ref #668120
2018-11-29 18:41:34 [INFO    ] Finished processing BAM request
2018-11-29 18:41:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668120   8 58451 67294029 A  ERROR'
2018-11-29 18:41:34 [DEBUG   ] Got command BAM from MCS: ref #668119
2018-11-29 18:41:34 [INFO    ] Finished processing BAM request
2018-11-29 18:41:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668119   8 58451 67294033 A  ERROR'
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:41:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:41:34 [DEBUG   ] spawn_process: at 2018-11-29 18:41:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:41:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:41:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:41:57 [DEBUG   ] Got command BAM from MCS: ref #668122
2018-11-29 18:41:57 [INFO    ] Finished processing BAM request
2018-11-29 18:41:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668122   8 58451 67317033 A  ERROR'
2018-11-29 18:41:57 [DEBUG   ] Got command BAM from MCS: ref #668121
2018-11-29 18:41:57 [INFO    ] Finished processing BAM request
2018-11-29 18:41:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668121   8 58451 67317037 A  ERROR'
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:41:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:41:57 [DEBUG   ] spawn_process: at 2018-11-29 18:41:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 18:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:41:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 18:41:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:41:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:41:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:41:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:41:59 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-29 18:42:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 18:42:20 [DEBUG   ] Got command BAM from MCS: ref #668123
2018-11-29 18:42:20 [INFO    ] Finished processing BAM request
2018-11-29 18:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668123   8 58451 67340029 A  ERROR'
2018-11-29 18:42:20 [DEBUG   ] Got command BAM from MCS: ref #668124
2018-11-29 18:42:20 [INFO    ] Finished processing BAM request
2018-11-29 18:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668124   8 58451 67340033 A  ERROR'
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:42:20 [DEBUG   ] spawn_process: at 2018-11-29 18:42:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:42:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:42:43 [DEBUG   ] Got command BAM from MCS: ref #668125
2018-11-29 18:42:43 [INFO    ] Finished processing BAM request
2018-11-29 18:42:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668125   8 58451 67363025 A  ERROR'
2018-11-29 18:42:43 [DEBUG   ] Got command BAM from MCS: ref #668126
2018-11-29 18:42:43 [INFO    ] Finished processing BAM request
2018-11-29 18:42:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668126   8 58451 67363029 A  ERROR'
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:42:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:42:43 [DEBUG   ] spawn_process: at 2018-11-29 18:42:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:42:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 18:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:42:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:42:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:42:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:42:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:42:59 [WARNING ] (13, 1, 'bot')
2018-11-29 18:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:42:59 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-29 18:43:06 [DEBUG   ] Got command BAM from MCS: ref #668128
2018-11-29 18:43:06 [INFO    ] Finished processing BAM request
2018-11-29 18:43:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668128   8 58451 67386033 A  ERROR'
2018-11-29 18:43:06 [DEBUG   ] Got command BAM from MCS: ref #668127
2018-11-29 18:43:06 [INFO    ] Finished processing BAM request
2018-11-29 18:43:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668127   8 58451 67386037 A  ERROR'
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:43:06 [DEBUG   ] spawn_process: at 2018-11-29 18:43:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:43:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 18:43:29 [DEBUG   ] Got command BAM from MCS: ref #668130
2018-11-29 18:43:29 [INFO    ] Finished processing BAM request
2018-11-29 18:43:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668130   8 58451 67409026 A  ERROR'
2018-11-29 18:43:29 [DEBUG   ] Got command BAM from MCS: ref #668129
2018-11-29 18:43:29 [INFO    ] Finished processing BAM request
2018-11-29 18:43:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668129   8 58451 67409030 A  ERROR'
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:43:29 [DEBUG   ] spawn_process: at 2018-11-29 18:43:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 18:43:52 [DEBUG   ] Got command BAM from MCS: ref #668133
2018-11-29 18:43:52 [INFO    ] Finished processing BAM request
2018-11-29 18:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668133   8 58451 67432026 A  ERROR'
2018-11-29 18:43:52 [DEBUG   ] Got command BAM from MCS: ref #668134
2018-11-29 18:43:52 [INFO    ] Finished processing BAM request
2018-11-29 18:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668134   8 58451 67432030 A  ERROR'
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:43:52 [DEBUG   ] spawn_process: at 2018-11-29 18:43:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:43:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 18:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 18:43:59 [DEBUG   ] Got command RPT from MCS: ref #668135
2018-11-29 18:43:59 [DEBUG   ] summary = ERROR
2018-11-29 18:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668135  13 58451 67439422 A  ERRORERROR'
2018-11-29 18:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 18:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:43:59 [DEBUG   ] Got command RPT from MCS: ref #668136
2018-11-29 18:43:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668136  77 58451 67439626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:43:59 [DEBUG   ] Got command RPT from MCS: ref #668137
2018-11-29 18:43:59 [DEBUG   ] summary = ERROR
2018-11-29 18:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668137  13 58451 67439829 A  ERRORERROR'
2018-11-29 18:44:00 [DEBUG   ] Got command RPT from MCS: ref #668139
2018-11-29 18:44:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668139  77 58451 67440034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:44:00 [DEBUG   ] Got command RPT from MCS: ref #668140
2018-11-29 18:44:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668140  12 58451 67440226 A  ERRORB›™š'
2018-11-29 18:44:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:44:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:44:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:44:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:44:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:44:00 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-11-29 18:44:15 [DEBUG   ] Got command BAM from MCS: ref #668150
2018-11-29 18:44:15 [INFO    ] Finished processing BAM request
2018-11-29 18:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668150   8 58451 67455026 A  ERROR'
2018-11-29 18:44:15 [DEBUG   ] Got command BAM from MCS: ref #668149
2018-11-29 18:44:15 [INFO    ] Finished processing BAM request
2018-11-29 18:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668149   8 58451 67455030 A  ERROR'
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:44:15 [DEBUG   ] spawn_process: at 2018-11-29 18:44:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:44:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 18:44:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:44:38 [DEBUG   ] Got command BAM from MCS: ref #668151
2018-11-29 18:44:38 [INFO    ] Finished processing BAM request
2018-11-29 18:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668151   8 58451 67478033 A  ERROR'
2018-11-29 18:44:38 [DEBUG   ] Got command BAM from MCS: ref #668152
2018-11-29 18:44:38 [INFO    ] Finished processing BAM request
2018-11-29 18:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668152   8 58451 67478037 A  ERROR'
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:44:38 [DEBUG   ] spawn_process: at 2018-11-29 18:44:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:44:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:45:00 [DEBUG   ] Got command BAM from MCS: ref #668153
2018-11-29 18:45:00 [INFO    ] Finished processing BAM request
2018-11-29 18:45:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668153   8 58451 67500029 A  ERROR'
2018-11-29 18:45:00 [DEBUG   ] Got command BAM from MCS: ref #668154
2018-11-29 18:45:00 [INFO    ] Finished processing BAM request
2018-11-29 18:45:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668154   8 58451 67500033 A  ERROR'
2018-11-29 18:45:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:45:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:45:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:45:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:45:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:45:00 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:45:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:45:00 [DEBUG   ] spawn_process: at 2018-11-29 18:45:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:45:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:45:22 [DEBUG   ] Got command BAM from MCS: ref #668156
2018-11-29 18:45:22 [INFO    ] Finished processing BAM request
2018-11-29 18:45:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668156   8 58451 67522025 A  ERROR'
2018-11-29 18:45:22 [DEBUG   ] Got command BAM from MCS: ref #668155
2018-11-29 18:45:22 [INFO    ] Finished processing BAM request
2018-11-29 18:45:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668155   8 58451 67522029 A  ERROR'
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:45:22 [DEBUG   ] spawn_process: at 2018-11-29 18:45:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:45:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 18:45:44 [DEBUG   ] Got command BAM from MCS: ref #668157
2018-11-29 18:45:44 [INFO    ] Finished processing BAM request
2018-11-29 18:45:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668157   8 58451 67544029 A  ERROR'
2018-11-29 18:45:44 [DEBUG   ] Got command BAM from MCS: ref #668158
2018-11-29 18:45:44 [INFO    ] Finished processing BAM request
2018-11-29 18:45:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668158   8 58451 67544033 A  ERROR'
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:45:44 [DEBUG   ] spawn_process: at 2018-11-29 18:45:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:45:49 [DEBUG   ] Got command RPT from MCS: ref #668159
2018-11-29 18:45:49 [DEBUG   ] summary = ERROR
2018-11-29 18:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668159  13 58451 67549769 A  ERRORERROR'
2018-11-29 18:45:49 [DEBUG   ] Got command RPT from MCS: ref #668160
2018-11-29 18:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668160  77 58451 67549770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:45:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 18:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 18:46:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:46:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:46:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:46:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:46:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:46:00 [DEBUG   ] Finished updating board flags in 1.101 seconds
2018-11-29 18:46:06 [DEBUG   ] Got command BAM from MCS: ref #668177
2018-11-29 18:46:06 [INFO    ] Finished processing BAM request
2018-11-29 18:46:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668177   8 58451 67566025 A  ERROR'
2018-11-29 18:46:06 [DEBUG   ] Got command BAM from MCS: ref #668176
2018-11-29 18:46:06 [INFO    ] Finished processing BAM request
2018-11-29 18:46:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668176   8 58451 67566029 A  ERROR'
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:46:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:46:06 [DEBUG   ] spawn_process: at 2018-11-29 18:46:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:46:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:46:28 [DEBUG   ] Got command BAM from MCS: ref #668179
2018-11-29 18:46:28 [INFO    ] Finished processing BAM request
2018-11-29 18:46:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668179   8 58451 67588033 A  ERROR'
2018-11-29 18:46:28 [DEBUG   ] Got command BAM from MCS: ref #668178
2018-11-29 18:46:28 [INFO    ] Finished processing BAM request
2018-11-29 18:46:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668178   8 58451 67588037 A  ERROR'
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:46:28 [DEBUG   ] spawn_process: at 2018-11-29 18:46:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:46:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:46:50 [DEBUG   ] Got command BAM from MCS: ref #668181
2018-11-29 18:46:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668181   8 58451 67610029 A  ERROR'
2018-11-29 18:46:50 [DEBUG   ] Got command BAM from MCS: ref #668180
2018-11-29 18:46:50 [INFO    ] Finished processing BAM request
2018-11-29 18:46:50 [INFO    ] Finished processing BAM request
2018-11-29 18:46:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668180   8 58451 67610037 A  ERROR'
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:46:50 [DEBUG   ] spawn_process: at 2018-11-29 18:46:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:46:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 18:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:47:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:47:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:47:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:47:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:47:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:47:01 [DEBUG   ] Finished updating board flags in 1.927 seconds
2018-11-29 18:47:12 [DEBUG   ] Got command BAM from MCS: ref #668183
2018-11-29 18:47:12 [INFO    ] Finished processing BAM request
2018-11-29 18:47:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668183   8 58451 67632029 A  ERROR'
2018-11-29 18:47:12 [DEBUG   ] Got command BAM from MCS: ref #668182
2018-11-29 18:47:12 [INFO    ] Finished processing BAM request
2018-11-29 18:47:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668182   8 58451 67632033 A  ERROR'
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:47:12 [DEBUG   ] spawn_process: at 2018-11-29 18:47:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:47:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:47:34 [DEBUG   ] Got command BAM from MCS: ref #668188
2018-11-29 18:47:34 [INFO    ] Finished processing BAM request
2018-11-29 18:47:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668188   8 58451 67654025 A  ERROR'
2018-11-29 18:47:34 [DEBUG   ] Got command BAM from MCS: ref #668189
2018-11-29 18:47:34 [INFO    ] Finished processing BAM request
2018-11-29 18:47:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668189   8 58451 67654029 A  ERROR'
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:47:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:47:34 [DEBUG   ] spawn_process: at 2018-11-29 18:47:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:47:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-29 18:47:56 [DEBUG   ] Got command BAM from MCS: ref #668191
2018-11-29 18:47:56 [INFO    ] Finished processing BAM request
2018-11-29 18:47:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:47:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668191   8 58451 67676033 A  ERROR'
2018-11-29 18:47:56 [DEBUG   ] Got command BAM from MCS: ref #668190
2018-11-29 18:47:56 [INFO    ] Finished processing BAM request
2018-11-29 18:47:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:47:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668190   8 58451 67676037 A  ERROR'
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:47:56 [DEBUG   ] spawn_process: at 2018-11-29 18:47:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:47:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:48:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:48:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:48:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:48:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:48:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:48:00 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-11-29 18:48:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:48:18 [DEBUG   ] Got command BAM from MCS: ref #668192
2018-11-29 18:48:18 [INFO    ] Finished processing BAM request
2018-11-29 18:48:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668192   8 58451 67698029 A  ERROR'
2018-11-29 18:48:18 [DEBUG   ] Got command BAM from MCS: ref #668193
2018-11-29 18:48:18 [INFO    ] Finished processing BAM request
2018-11-29 18:48:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668193   8 58451 67698033 A  ERROR'
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:48:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:48:18 [DEBUG   ] spawn_process: at 2018-11-29 18:48:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:48:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:48:40 [DEBUG   ] Got command BAM from MCS: ref #668194
2018-11-29 18:48:40 [INFO    ] Finished processing BAM request
2018-11-29 18:48:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668194   8 58451 67720025 A  ERROR'
2018-11-29 18:48:40 [DEBUG   ] Got command BAM from MCS: ref #668195
2018-11-29 18:48:40 [INFO    ] Finished processing BAM request
2018-11-29 18:48:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668195   8 58451 67720029 A  ERROR'
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:48:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:48:40 [DEBUG   ] spawn_process: at 2018-11-29 18:48:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:48:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:48:59 [DEBUG   ] Got command RPT from MCS: ref #668196
2018-11-29 18:48:59 [DEBUG   ] summary = ERROR
2018-11-29 18:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668196  13 58451 67739509 A  ERRORERROR'
2018-11-29 18:48:59 [DEBUG   ] Got command RPT from MCS: ref #668197
2018-11-29 18:48:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668197  77 58451 67739713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:48:59 [DEBUG   ] Got command RPT from MCS: ref #668198
2018-11-29 18:48:59 [DEBUG   ] summary = ERROR
2018-11-29 18:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668198  13 58451 67739917 A  ERRORERROR'
2018-11-29 18:49:00 [DEBUG   ] Got command RPT from MCS: ref #668199
2018-11-29 18:49:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668199  77 58451 67740121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 18:49:00 [DEBUG   ] Got command RPT from MCS: ref #668200
2018-11-29 18:49:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668200  12 58451 67740313 A  ERRORB™™š'
2018-11-29 18:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:49:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:49:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:49:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:49:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:49:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:49:01 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-11-29 18:49:02 [DEBUG   ] Got command BAM from MCS: ref #668201
2018-11-29 18:49:02 [INFO    ] Finished processing BAM request
2018-11-29 18:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668201   8 58451 67742025 A  ERROR'
2018-11-29 18:49:02 [DEBUG   ] Got command BAM from MCS: ref #668202
2018-11-29 18:49:02 [INFO    ] Finished processing BAM request
2018-11-29 18:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668202   8 58451 67742029 A  ERROR'
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:49:02 [DEBUG   ] spawn_process: at 2018-11-29 18:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:49:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:49:24 [DEBUG   ] Got command BAM from MCS: ref #668203
2018-11-29 18:49:24 [INFO    ] Finished processing BAM request
2018-11-29 18:49:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668203   8 58451 67764029 A  ERROR'
2018-11-29 18:49:24 [DEBUG   ] Got command BAM from MCS: ref #668204
2018-11-29 18:49:24 [INFO    ] Finished processing BAM request
2018-11-29 18:49:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668204   8 58451 67764033 A  ERROR'
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:49:24 [DEBUG   ] spawn_process: at 2018-11-29 18:49:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:49:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:49:46 [DEBUG   ] Got command BAM from MCS: ref #668205
2018-11-29 18:49:46 [INFO    ] Finished processing BAM request
2018-11-29 18:49:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668205   8 58451 67786025 A  ERROR'
2018-11-29 18:49:46 [DEBUG   ] Got command BAM from MCS: ref #668206
2018-11-29 18:49:46 [INFO    ] Finished processing BAM request
2018-11-29 18:49:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668206   8 58451 67786029 A  ERROR'
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:49:46 [DEBUG   ] spawn_process: at 2018-11-29 18:49:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:49:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-11-29 18:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 18:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:50:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:50:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:50:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:50:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:50:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:50:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:50:00 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-11-29 18:50:08 [DEBUG   ] Got command BAM from MCS: ref #668207
2018-11-29 18:50:08 [INFO    ] Finished processing BAM request
2018-11-29 18:50:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668207   8 58451 67808025 A  ERROR'
2018-11-29 18:50:08 [DEBUG   ] Got command BAM from MCS: ref #668208
2018-11-29 18:50:08 [INFO    ] Finished processing BAM request
2018-11-29 18:50:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668208   8 58451 67808029 A  ERROR'
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:50:08 [DEBUG   ] spawn_process: at 2018-11-29 18:50:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:50:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:50:30 [DEBUG   ] Got command BAM from MCS: ref #668214
2018-11-29 18:50:30 [INFO    ] Finished processing BAM request
2018-11-29 18:50:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668214   8 58451 67830402 A  ERROR'
2018-11-29 18:50:30 [DEBUG   ] Got command BAM from MCS: ref #668213
2018-11-29 18:50:30 [INFO    ] Finished processing BAM request
2018-11-29 18:50:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668213   8 58451 67830406 A  ERROR'
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:50:30 [DEBUG   ] spawn_process: at 2018-11-29 18:50:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:50:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:50:49 [DEBUG   ] Got command RPT from MCS: ref #668215
2018-11-29 18:50:49 [DEBUG   ] summary = ERROR
2018-11-29 18:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668215  13 58451 67849773 A  ERRORERROR'
2018-11-29 18:50:49 [DEBUG   ] Got command RPT from MCS: ref #668216
2018-11-29 18:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668216  77 58451 67849774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:50:52 [DEBUG   ] Got command BAM from MCS: ref #668232
2018-11-29 18:50:52 [INFO    ] Finished processing BAM request
2018-11-29 18:50:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:50:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668232   8 58451 67852034 A  ERROR'
2018-11-29 18:50:52 [DEBUG   ] Got command BAM from MCS: ref #668233
2018-11-29 18:50:52 [INFO    ] Finished processing BAM request
2018-11-29 18:50:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:50:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668233   8 58451 67852038 A  ERROR'
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:50:52 [DEBUG   ] spawn_process: at 2018-11-29 18:50:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:50:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 18:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 18:51:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:51:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:51:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:51:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:51:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:51:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:51:00 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-29 18:51:14 [DEBUG   ] Got command BAM from MCS: ref #668235
2018-11-29 18:51:14 [INFO    ] Finished processing BAM request
2018-11-29 18:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668235   8 58451 67874026 A  ERROR'
2018-11-29 18:51:14 [DEBUG   ] Got command BAM from MCS: ref #668234
2018-11-29 18:51:14 [INFO    ] Finished processing BAM request
2018-11-29 18:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668234   8 58451 67874030 A  ERROR'
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:51:14 [DEBUG   ] spawn_process: at 2018-11-29 18:51:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:51:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:51:36 [DEBUG   ] Got command BAM from MCS: ref #668236
2018-11-29 18:51:36 [INFO    ] Finished processing BAM request
2018-11-29 18:51:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668236   8 58451 67896033 A  ERROR'
2018-11-29 18:51:36 [DEBUG   ] Got command BAM from MCS: ref #668237
2018-11-29 18:51:36 [INFO    ] Finished processing BAM request
2018-11-29 18:51:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668237   8 58451 67896037 A  ERROR'
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:51:36 [DEBUG   ] spawn_process: at 2018-11-29 18:51:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:51:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:51:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:51:58 [DEBUG   ] Got command BAM from MCS: ref #668238
2018-11-29 18:51:58 [INFO    ] Finished processing BAM request
2018-11-29 18:51:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668238   8 58451 67918033 A  ERROR'
2018-11-29 18:51:58 [DEBUG   ] Got command BAM from MCS: ref #668239
2018-11-29 18:51:58 [INFO    ] Finished processing BAM request
2018-11-29 18:51:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668239   8 58451 67918037 A  ERROR'
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:51:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:51:58 [DEBUG   ] spawn_process: at 2018-11-29 18:51:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-11-29 18:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 18:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:52:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:52:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:52:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:52:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:52:00 [WARNING ] (13, 1, 'bot')
2018-11-29 18:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:52:00 [DEBUG   ] Finished updating board flags in 0.959 seconds
2018-11-29 18:52:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:52:20 [DEBUG   ] Got command BAM from MCS: ref #668240
2018-11-29 18:52:20 [INFO    ] Finished processing BAM request
2018-11-29 18:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668240   8 58451 67940033 A  ERROR'
2018-11-29 18:52:20 [DEBUG   ] Got command BAM from MCS: ref #668241
2018-11-29 18:52:20 [INFO    ] Finished processing BAM request
2018-11-29 18:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668241   8 58451 67940037 A  ERROR'
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:52:20 [DEBUG   ] spawn_process: at 2018-11-29 18:52:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:52:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:52:42 [DEBUG   ] Got command BAM from MCS: ref #668242
2018-11-29 18:52:42 [INFO    ] Finished processing BAM request
2018-11-29 18:52:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668242   8 58451 67962029 A  ERROR'
2018-11-29 18:52:42 [DEBUG   ] Got command BAM from MCS: ref #668243
2018-11-29 18:52:42 [INFO    ] Finished processing BAM request
2018-11-29 18:52:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668243   8 58451 67962033 A  ERROR'
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:52:42 [DEBUG   ] spawn_process: at 2018-11-29 18:52:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:52:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 18:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 18:53:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:53:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:53:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:53:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:53:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:53:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:53:01 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-29 18:53:04 [DEBUG   ] Got command BAM from MCS: ref #668244
2018-11-29 18:53:04 [INFO    ] Finished processing BAM request
2018-11-29 18:53:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:53:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668244   8 58451 67984025 A  ERROR'
2018-11-29 18:53:04 [DEBUG   ] Got command BAM from MCS: ref #668245
2018-11-29 18:53:04 [INFO    ] Finished processing BAM request
2018-11-29 18:53:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:53:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668245   8 58451 67984029 A  ERROR'
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:53:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:53:04 [DEBUG   ] spawn_process: at 2018-11-29 18:53:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:53:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:53:26 [DEBUG   ] Got command BAM from MCS: ref #668250
2018-11-29 18:53:26 [INFO    ] Finished processing BAM request
2018-11-29 18:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668250   8 58451 68006029 A  ERROR'
2018-11-29 18:53:26 [DEBUG   ] Got command BAM from MCS: ref #668251
2018-11-29 18:53:26 [INFO    ] Finished processing BAM request
2018-11-29 18:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668251   8 58451 68006033 A  ERROR'
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:53:26 [DEBUG   ] spawn_process: at 2018-11-29 18:53:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:53:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:53:48 [DEBUG   ] Got command BAM from MCS: ref #668254
2018-11-29 18:53:48 [INFO    ] Finished processing BAM request
2018-11-29 18:53:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668254   8 58451 68028029 A  ERROR'
2018-11-29 18:53:48 [DEBUG   ] Got command BAM from MCS: ref #668255
2018-11-29 18:53:48 [INFO    ] Finished processing BAM request
2018-11-29 18:53:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:53:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668255   8 58451 68028033 A  ERROR'
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:53:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:53:48 [DEBUG   ] spawn_process: at 2018-11-29 18:53:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:53:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:53:59 [DEBUG   ] Got command RPT from MCS: ref #668256
2018-11-29 18:53:59 [DEBUG   ] summary = ERROR
2018-11-29 18:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668256  13 58451 68039601 A  ERRORERROR'
2018-11-29 18:53:59 [DEBUG   ] Got command RPT from MCS: ref #668257
2018-11-29 18:53:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668257  77 58451 68039805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:53:59 [DEBUG   ] Got command RPT from MCS: ref #668258
2018-11-29 18:53:59 [DEBUG   ] summary = ERROR
2018-11-29 18:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668258  13 58451 68039997 A  ERRORERROR'
2018-11-29 18:54:00 [DEBUG   ] Got command RPT from MCS: ref #668260
2018-11-29 18:54:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668260  77 58451 68040201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:54:00 [DEBUG   ] Got command RPT from MCS: ref #668261
2018-11-29 18:54:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668261  12 58451 68040406 A  ERRORB�ÌÍ'
2018-11-29 18:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:54:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:54:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:54:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:54:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:54:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:54:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:54:01 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-29 18:54:10 [DEBUG   ] Got command BAM from MCS: ref #668267
2018-11-29 18:54:10 [INFO    ] Finished processing BAM request
2018-11-29 18:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668267   8 58451 68050041 A  ERROR'
2018-11-29 18:54:10 [DEBUG   ] Got command BAM from MCS: ref #668266
2018-11-29 18:54:10 [INFO    ] Finished processing BAM request
2018-11-29 18:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668266   8 58451 68050045 A  ERROR'
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:54:10 [DEBUG   ] spawn_process: at 2018-11-29 18:54:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:54:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:54:31 [DEBUG   ] Got command BAM from MCS: ref #668268
2018-11-29 18:54:31 [INFO    ] Finished processing BAM request
2018-11-29 18:54:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668268   8 58451 68071029 A  ERROR'
2018-11-29 18:54:31 [DEBUG   ] Got command BAM from MCS: ref #668269
2018-11-29 18:54:31 [INFO    ] Finished processing BAM request
2018-11-29 18:54:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668269   8 58451 68071033 A  ERROR'
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:54:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:54:31 [DEBUG   ] spawn_process: at 2018-11-29 18:54:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:54:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:54:52 [DEBUG   ] Got command BAM from MCS: ref #668270
2018-11-29 18:54:52 [INFO    ] Finished processing BAM request
2018-11-29 18:54:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668270   8 58451 68092033 A  ERROR'
2018-11-29 18:54:52 [DEBUG   ] Got command BAM from MCS: ref #668271
2018-11-29 18:54:52 [INFO    ] Finished processing BAM request
2018-11-29 18:54:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668271   8 58451 68092037 A  ERROR'
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:54:52 [DEBUG   ] spawn_process: at 2018-11-29 18:54:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:54:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 18:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 18:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 18:55:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:55:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:55:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:55:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:55:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:55:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:55:01 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-29 18:55:13 [DEBUG   ] Got command BAM from MCS: ref #668273
2018-11-29 18:55:13 [INFO    ] Finished processing BAM request
2018-11-29 18:55:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668273   8 58451 68113025 A  ERROR'
2018-11-29 18:55:13 [DEBUG   ] Got command BAM from MCS: ref #668272
2018-11-29 18:55:13 [INFO    ] Finished processing BAM request
2018-11-29 18:55:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668272   8 58451 68113029 A  ERROR'
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:55:13 [DEBUG   ] spawn_process: at 2018-11-29 18:55:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:55:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 18:55:34 [DEBUG   ] Got command BAM from MCS: ref #668275
2018-11-29 18:55:34 [INFO    ] Finished processing BAM request
2018-11-29 18:55:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668275   8 58451 68134025 A  ERROR'
2018-11-29 18:55:34 [DEBUG   ] Got command BAM from MCS: ref #668274
2018-11-29 18:55:34 [INFO    ] Finished processing BAM request
2018-11-29 18:55:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668274   8 58451 68134029 A  ERROR'
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:55:34 [DEBUG   ] spawn_process: at 2018-11-29 18:55:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:55:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:55:49 [DEBUG   ] Got command RPT from MCS: ref #668276
2018-11-29 18:55:49 [DEBUG   ] summary = ERROR
2018-11-29 18:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668276  13 58451 68149765 A  ERRORERROR'
2018-11-29 18:55:49 [DEBUG   ] Got command RPT from MCS: ref #668277
2018-11-29 18:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668277  77 58451 68149766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:55:55 [DEBUG   ] Got command BAM from MCS: ref #668293
2018-11-29 18:55:55 [INFO    ] Finished processing BAM request
2018-11-29 18:55:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:55:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668293   8 58451 68155025 A  ERROR'
2018-11-29 18:55:55 [DEBUG   ] Got command BAM from MCS: ref #668294
2018-11-29 18:55:55 [INFO    ] Finished processing BAM request
2018-11-29 18:55:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:55:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668294   8 58451 68155029 A  ERROR'
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:55:55 [DEBUG   ] spawn_process: at 2018-11-29 18:55:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:55:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 18:56:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:56:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:56:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 18:56:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:56:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:56:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:56:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:56:01 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-29 18:56:16 [DEBUG   ] Got command BAM from MCS: ref #668300
2018-11-29 18:56:16 [INFO    ] Finished processing BAM request
2018-11-29 18:56:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668300   8 58451 68176029 A  ERROR'
2018-11-29 18:56:16 [DEBUG   ] Got command BAM from MCS: ref #668299
2018-11-29 18:56:16 [INFO    ] Finished processing BAM request
2018-11-29 18:56:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668299   8 58451 68176033 A  ERROR'
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:56:16 [DEBUG   ] spawn_process: at 2018-11-29 18:56:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:56:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:56:37 [DEBUG   ] Got command BAM from MCS: ref #668301
2018-11-29 18:56:37 [INFO    ] Finished processing BAM request
2018-11-29 18:56:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668301   8 58451 68197033 A  ERROR'
2018-11-29 18:56:37 [DEBUG   ] Got command BAM from MCS: ref #668302
2018-11-29 18:56:37 [INFO    ] Finished processing BAM request
2018-11-29 18:56:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668302   8 58451 68197041 A  ERROR'
2018-11-29 18:56:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:56:37 [DEBUG   ] spawn_process: at 2018-11-29 18:56:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:56:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-29 18:56:58 [DEBUG   ] Got command BAM from MCS: ref #668303
2018-11-29 18:56:58 [INFO    ] Finished processing BAM request
2018-11-29 18:56:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668303   8 58451 68218029 A  ERROR'
2018-11-29 18:56:58 [DEBUG   ] Got command BAM from MCS: ref #668304
2018-11-29 18:56:58 [INFO    ] Finished processing BAM request
2018-11-29 18:56:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668304   8 58451 68218033 A  ERROR'
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:56:58 [DEBUG   ] spawn_process: at 2018-11-29 18:56:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 18:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 18:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 18:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 18:57:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 18:57:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:57:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 18:57:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:57:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:57:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:57:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:57:01 [DEBUG   ] Finished updating board flags in 1.272 seconds
2018-11-29 18:57:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 18:57:19 [DEBUG   ] Got command BAM from MCS: ref #668306
2018-11-29 18:57:19 [INFO    ] Finished processing BAM request
2018-11-29 18:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668306   8 58451 68239029 A  ERROR'
2018-11-29 18:57:19 [DEBUG   ] Got command BAM from MCS: ref #668305
2018-11-29 18:57:19 [INFO    ] Finished processing BAM request
2018-11-29 18:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668305   8 58451 68239033 A  ERROR'
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:57:19 [DEBUG   ] spawn_process: at 2018-11-29 18:57:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:57:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:57:40 [DEBUG   ] Got command BAM from MCS: ref #668308
2018-11-29 18:57:40 [INFO    ] Finished processing BAM request
2018-11-29 18:57:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668308   8 58451 68260025 A  ERROR'
2018-11-29 18:57:40 [DEBUG   ] Got command BAM from MCS: ref #668307
2018-11-29 18:57:40 [INFO    ] Finished processing BAM request
2018-11-29 18:57:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668307   8 58451 68260029 A  ERROR'
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 18:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 18:57:40 [DEBUG   ] spawn_process: at 2018-11-29 18:57:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 18:57:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:58:01 [DEBUG   ] Got command BAM from MCS: ref #668309
2018-11-29 18:58:01 [INFO    ] Finished processing BAM request
2018-11-29 18:58:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668309   8 58451 68281041 A  ERROR'
2018-11-29 18:58:01 [DEBUG   ] Got command BAM from MCS: ref #668310
2018-11-29 18:58:01 [INFO    ] Finished processing BAM request
2018-11-29 18:58:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668310   8 58451 68281045 A  ERROR'
2018-11-29 18:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 18:58:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:58:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:58:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 18:58:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 18:58:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:58:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:58:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:58:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:58:01 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 18:58:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 18:58:01 [DEBUG   ] spawn_process: at 2018-11-29 18:58:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 18:58:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:58:22 [DEBUG   ] Got command BAM from MCS: ref #668312
2018-11-29 18:58:22 [INFO    ] Finished processing BAM request
2018-11-29 18:58:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668312   8 58451 68302025 A  ERROR'
2018-11-29 18:58:22 [DEBUG   ] Got command BAM from MCS: ref #668311
2018-11-29 18:58:22 [INFO    ] Finished processing BAM request
2018-11-29 18:58:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668311   8 58451 68302029 A  ERROR'
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:58:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:58:22 [DEBUG   ] spawn_process: at 2018-11-29 18:58:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:58:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:58:43 [DEBUG   ] Got command BAM from MCS: ref #668313
2018-11-29 18:58:43 [INFO    ] Finished processing BAM request
2018-11-29 18:58:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668313   8 58451 68323025 A  ERROR'
2018-11-29 18:58:43 [DEBUG   ] Got command BAM from MCS: ref #668314
2018-11-29 18:58:43 [INFO    ] Finished processing BAM request
2018-11-29 18:58:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:58:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668314   8 58451 68323029 A  ERROR'
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:58:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:58:43 [DEBUG   ] spawn_process: at 2018-11-29 18:58:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:58:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:58:59 [DEBUG   ] Got command RPT from MCS: ref #668315
2018-11-29 18:58:59 [DEBUG   ] summary = ERROR
2018-11-29 18:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668315  13 58451 68339681 A  ERRORERROR'
2018-11-29 18:58:59 [DEBUG   ] Got command RPT from MCS: ref #668316
2018-11-29 18:58:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668316  77 58451 68339885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:59:00 [DEBUG   ] Got command RPT from MCS: ref #668317
2018-11-29 18:59:00 [DEBUG   ] summary = ERROR
2018-11-29 18:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668317  13 58451 68340089 A  ERRORERROR'
2018-11-29 18:59:00 [DEBUG   ] Got command RPT from MCS: ref #668318
2018-11-29 18:59:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 18:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668318  77 58451 68340281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 18:59:00 [DEBUG   ] Got command RPT from MCS: ref #668319
2018-11-29 18:59:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 18:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668319  12 58451 68340485 A  ERRORB¤ff'
2018-11-29 18:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 18:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 18:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 18:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 18:59:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 18:59:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 18:59:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:59:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:59:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:59:01 [WARNING ] (13, 1, 'bot')
2018-11-29 18:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 18:59:01 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-29 18:59:04 [DEBUG   ] Got command BAM from MCS: ref #668320
2018-11-29 18:59:04 [INFO    ] Finished processing BAM request
2018-11-29 18:59:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668320   8 58451 68344029 A  ERROR'
2018-11-29 18:59:04 [DEBUG   ] Got command BAM from MCS: ref #668321
2018-11-29 18:59:04 [INFO    ] Finished processing BAM request
2018-11-29 18:59:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668321   8 58451 68344033 A  ERROR'
2018-11-29 18:59:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 18:59:04 [DEBUG   ] spawn_process: at 2018-11-29 18:59:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 18:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 18:59:05 [DEBUG   ] spawn_process: at 2018-11-29 18:59:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 18:59:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:59:25 [DEBUG   ] Got command BAM from MCS: ref #668327
2018-11-29 18:59:25 [INFO    ] Finished processing BAM request
2018-11-29 18:59:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668327   8 58451 68365033 A  ERROR'
2018-11-29 18:59:25 [DEBUG   ] Got command BAM from MCS: ref #668326
2018-11-29 18:59:25 [INFO    ] Finished processing BAM request
2018-11-29 18:59:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668326   8 58451 68365037 A  ERROR'
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 18:59:25 [DEBUG   ] spawn_process: at 2018-11-29 18:59:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 18:59:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 18:59:46 [DEBUG   ] Got command BAM from MCS: ref #668328
2018-11-29 18:59:46 [INFO    ] Finished processing BAM request
2018-11-29 18:59:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668328   8 58451 68386033 A  ERROR'
2018-11-29 18:59:46 [DEBUG   ] Got command BAM from MCS: ref #668329
2018-11-29 18:59:46 [INFO    ] Finished processing BAM request
2018-11-29 18:59:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 18:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668329   8 58451 68386037 A  ERROR'
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 18:59:46 [DEBUG   ] spawn_process: at 2018-11-29 18:59:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 18:59:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:00:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:00:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:00:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:00:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:00:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:00:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:00:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:00:01 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-29 19:00:07 [DEBUG   ] Got command BAM from MCS: ref #668330
2018-11-29 19:00:07 [INFO    ] Finished processing BAM request
2018-11-29 19:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668330   8 58451 68407025 A  ERROR'
2018-11-29 19:00:07 [DEBUG   ] Got command BAM from MCS: ref #668331
2018-11-29 19:00:07 [INFO    ] Finished processing BAM request
2018-11-29 19:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668331   8 58451 68407029 A  ERROR'
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:00:07 [DEBUG   ] spawn_process: at 2018-11-29 19:00:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:00:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:00:28 [DEBUG   ] Got command BAM from MCS: ref #668332
2018-11-29 19:00:28 [INFO    ] Finished processing BAM request
2018-11-29 19:00:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668332   8 58451 68428033 A  ERROR'
2018-11-29 19:00:28 [DEBUG   ] Got command BAM from MCS: ref #668333
2018-11-29 19:00:28 [INFO    ] Finished processing BAM request
2018-11-29 19:00:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668333   8 58451 68428037 A  ERROR'
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:00:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:00:28 [DEBUG   ] spawn_process: at 2018-11-29 19:00:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:00:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:00:49 [DEBUG   ] Got command BAM from MCS: ref #668334
2018-11-29 19:00:49 [INFO    ] Finished processing BAM request
2018-11-29 19:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668334   8 58451 68449033 A  ERROR'
2018-11-29 19:00:49 [DEBUG   ] Got command BAM from MCS: ref #668335
2018-11-29 19:00:49 [INFO    ] Finished processing BAM request
2018-11-29 19:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668335   8 58451 68449037 A  ERROR'
2018-11-29 19:00:49 [DEBUG   ] Got command RPT from MCS: ref #668336
2018-11-29 19:00:49 [DEBUG   ] summary = ERROR
2018-11-29 19:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668336  13 58451 68449769 A  ERRORERROR'
2018-11-29 19:00:49 [DEBUG   ] Got command RPT from MCS: ref #668337
2018-11-29 19:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668337  77 58451 68449770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:00:49 [DEBUG   ] spawn_process: at 2018-11-29 19:00:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:00:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 19:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:01:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:01:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:01:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:01:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:01:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:01:01 [WARNING ] (13, 1, 'bot')
2018-11-29 19:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:01:01 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-11-29 19:01:10 [DEBUG   ] Got command BAM from MCS: ref #668354
2018-11-29 19:01:10 [INFO    ] Finished processing BAM request
2018-11-29 19:01:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668354   8 58451 68470033 A  ERROR'
2018-11-29 19:01:10 [DEBUG   ] Got command BAM from MCS: ref #668353
2018-11-29 19:01:10 [INFO    ] Finished processing BAM request
2018-11-29 19:01:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668353   8 58451 68470037 A  ERROR'
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:01:10 [DEBUG   ] spawn_process: at 2018-11-29 19:01:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:01:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:01:31 [DEBUG   ] Got command BAM from MCS: ref #668355
2018-11-29 19:01:31 [INFO    ] Finished processing BAM request
2018-11-29 19:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668355   8 58451 68491029 A  ERROR'
2018-11-29 19:01:31 [DEBUG   ] Got command BAM from MCS: ref #668356
2018-11-29 19:01:31 [INFO    ] Finished processing BAM request
2018-11-29 19:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668356   8 58451 68491033 A  ERROR'
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:01:31 [DEBUG   ] spawn_process: at 2018-11-29 19:01:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:01:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:01:52 [DEBUG   ] Got command BAM from MCS: ref #668358
2018-11-29 19:01:52 [INFO    ] Finished processing BAM request
2018-11-29 19:01:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668358   8 58451 68512033 A  ERROR'
2018-11-29 19:01:52 [DEBUG   ] Got command BAM from MCS: ref #668357
2018-11-29 19:01:52 [INFO    ] Finished processing BAM request
2018-11-29 19:01:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668357   8 58451 68512037 A  ERROR'
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:01:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:01:52 [DEBUG   ] spawn_process: at 2018-11-29 19:01:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:01:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 19:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:02:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:02:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:02:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:02:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:02:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:02:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:02:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:02:02 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-11-29 19:02:13 [DEBUG   ] Got command BAM from MCS: ref #668362
2018-11-29 19:02:13 [INFO    ] Finished processing BAM request
2018-11-29 19:02:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668362   8 58451 68533025 A  ERROR'
2018-11-29 19:02:13 [DEBUG   ] Got command BAM from MCS: ref #668363
2018-11-29 19:02:13 [INFO    ] Finished processing BAM request
2018-11-29 19:02:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668363   8 58451 68533029 A  ERROR'
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:02:13 [DEBUG   ] spawn_process: at 2018-11-29 19:02:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:02:17 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-29 19:02:34 [DEBUG   ] Got command BAM from MCS: ref #668366
2018-11-29 19:02:34 [INFO    ] Finished processing BAM request
2018-11-29 19:02:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668366   8 58451 68554029 A  ERROR'
2018-11-29 19:02:34 [DEBUG   ] Got command BAM from MCS: ref #668365
2018-11-29 19:02:34 [INFO    ] Finished processing BAM request
2018-11-29 19:02:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668365   8 58451 68554033 A  ERROR'
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:02:34 [DEBUG   ] spawn_process: at 2018-11-29 19:02:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:02:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-29 19:02:55 [DEBUG   ] Got command BAM from MCS: ref #668367
2018-11-29 19:02:55 [INFO    ] Finished processing BAM request
2018-11-29 19:02:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:02:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668367   8 58451 68575029 A  ERROR'
2018-11-29 19:02:55 [DEBUG   ] Got command BAM from MCS: ref #668368
2018-11-29 19:02:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:02:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668368   8 58451 68575033 A  ERROR'
2018-11-29 19:02:55 [INFO    ] Finished processing BAM request
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:02:55 [DEBUG   ] spawn_process: at 2018-11-29 19:02:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:02:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 19:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:03:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:03:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:03:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:03:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:03:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:03:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:03:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:03:02 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-29 19:03:16 [DEBUG   ] Got command BAM from MCS: ref #668370
2018-11-29 19:03:16 [INFO    ] Finished processing BAM request
2018-11-29 19:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668370   8 58451 68596025 A  ERROR'
2018-11-29 19:03:16 [DEBUG   ] Got command BAM from MCS: ref #668369
2018-11-29 19:03:16 [INFO    ] Finished processing BAM request
2018-11-29 19:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668369   8 58451 68596029 A  ERROR'
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:03:16 [DEBUG   ] spawn_process: at 2018-11-29 19:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:03:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:03:37 [DEBUG   ] Got command BAM from MCS: ref #668372
2018-11-29 19:03:37 [INFO    ] Finished processing BAM request
2018-11-29 19:03:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668372   8 58451 68617033 A  ERROR'
2018-11-29 19:03:37 [DEBUG   ] Got command BAM from MCS: ref #668371
2018-11-29 19:03:37 [INFO    ] Finished processing BAM request
2018-11-29 19:03:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668371   8 58451 68617041 A  ERROR'
2018-11-29 19:03:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:03:37 [DEBUG   ] spawn_process: at 2018-11-29 19:03:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:03:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:03:58 [DEBUG   ] Got command BAM from MCS: ref #668375
2018-11-29 19:03:58 [INFO    ] Finished processing BAM request
2018-11-29 19:03:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668375   8 58451 68638033 A  ERROR'
2018-11-29 19:03:58 [DEBUG   ] Got command BAM from MCS: ref #668376
2018-11-29 19:03:58 [INFO    ] Finished processing BAM request
2018-11-29 19:03:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668376   8 58451 68638037 A  ERROR'
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:03:58 [DEBUG   ] spawn_process: at 2018-11-29 19:03:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:03:59 [DEBUG   ] Got command RPT from MCS: ref #668377
2018-11-29 19:03:59 [DEBUG   ] summary = ERROR
2018-11-29 19:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668377  13 58451 68639769 A  ERRORERROR'
2018-11-29 19:03:59 [DEBUG   ] Got command RPT from MCS: ref #668378
2018-11-29 19:03:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668378  77 58451 68639973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:04:00 [DEBUG   ] Got command RPT from MCS: ref #668379
2018-11-29 19:04:00 [DEBUG   ] summary = ERROR
2018-11-29 19:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668379  13 58451 68640165 A  ERRORERROR'
2018-11-29 19:04:00 [DEBUG   ] Got command RPT from MCS: ref #668380
2018-11-29 19:04:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668380  77 58451 68640369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:04:00 [DEBUG   ] Got command RPT from MCS: ref #668382
2018-11-29 19:04:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668382  12 58451 68640573 A  ERRORB£ff'
2018-11-29 19:04:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 19:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:04:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:04:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:04:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:04:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:04:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:04:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:04:02 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-29 19:04:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:04:19 [DEBUG   ] Got command BAM from MCS: ref #668387
2018-11-29 19:04:19 [INFO    ] Finished processing BAM request
2018-11-29 19:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668387   8 58451 68659025 A  ERROR'
2018-11-29 19:04:19 [DEBUG   ] Got command BAM from MCS: ref #668388
2018-11-29 19:04:19 [INFO    ] Finished processing BAM request
2018-11-29 19:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668388   8 58451 68659029 A  ERROR'
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:04:19 [DEBUG   ] spawn_process: at 2018-11-29 19:04:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:04:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:04:40 [DEBUG   ] Got command BAM from MCS: ref #668390
2018-11-29 19:04:40 [INFO    ] Finished processing BAM request
2018-11-29 19:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668390   8 58451 68680025 A  ERROR'
2018-11-29 19:04:40 [DEBUG   ] Got command BAM from MCS: ref #668389
2018-11-29 19:04:40 [INFO    ] Finished processing BAM request
2018-11-29 19:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668389   8 58451 68680029 A  ERROR'
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:04:40 [DEBUG   ] spawn_process: at 2018-11-29 19:04:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:04:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:05:01 [DEBUG   ] Got command BAM from MCS: ref #668391
2018-11-29 19:05:01 [INFO    ] Finished processing BAM request
2018-11-29 19:05:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668391   8 58451 68701025 A  ERROR'
2018-11-29 19:05:01 [DEBUG   ] Got command BAM from MCS: ref #668392
2018-11-29 19:05:01 [INFO    ] Finished processing BAM request
2018-11-29 19:05:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668392   8 58451 68701029 A  ERROR'
2018-11-29 19:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 19:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:05:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:05:01 [DEBUG   ] spawn_process: at 2018-11-29 19:05:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:05:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:05:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:05:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:05:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:05:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:05:02 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-29 19:05:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:05:22 [DEBUG   ] Got command BAM from MCS: ref #668397
2018-11-29 19:05:22 [INFO    ] Finished processing BAM request
2018-11-29 19:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668397   8 58451 68722029 A  ERROR'
2018-11-29 19:05:22 [DEBUG   ] Got command BAM from MCS: ref #668398
2018-11-29 19:05:22 [INFO    ] Finished processing BAM request
2018-11-29 19:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668398   8 58451 68722033 A  ERROR'
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:05:22 [DEBUG   ] spawn_process: at 2018-11-29 19:05:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:05:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:05:43 [DEBUG   ] Got command BAM from MCS: ref #668399
2018-11-29 19:05:43 [INFO    ] Finished processing BAM request
2018-11-29 19:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668399   8 58451 68743025 A  ERROR'
2018-11-29 19:05:43 [DEBUG   ] Got command BAM from MCS: ref #668400
2018-11-29 19:05:43 [INFO    ] Finished processing BAM request
2018-11-29 19:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668400   8 58451 68743029 A  ERROR'
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:05:43 [DEBUG   ] spawn_process: at 2018-11-29 19:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:05:49 [DEBUG   ] Got command RPT from MCS: ref #668401
2018-11-29 19:05:49 [DEBUG   ] summary = ERROR
2018-11-29 19:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668401  13 58451 68749773 A  ERRORERROR'
2018-11-29 19:05:49 [DEBUG   ] Got command RPT from MCS: ref #668402
2018-11-29 19:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668402  77 58451 68749774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:05:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 19:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:06:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:06:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:06:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:06:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:06:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:06:03 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-11-29 19:06:04 [DEBUG   ] Got command BAM from MCS: ref #668418
2018-11-29 19:06:04 [INFO    ] Finished processing BAM request
2018-11-29 19:06:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668418   8 58451 68764033 A  ERROR'
2018-11-29 19:06:04 [DEBUG   ] Got command BAM from MCS: ref #668419
2018-11-29 19:06:04 [INFO    ] Finished processing BAM request
2018-11-29 19:06:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668419   8 58451 68764037 A  ERROR'
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:06:04 [DEBUG   ] spawn_process: at 2018-11-29 19:06:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:06:17 [DEBUG   ] Finished updating ant stats in 0.393 seconds
2018-11-29 19:06:25 [DEBUG   ] Got command BAM from MCS: ref #668420
2018-11-29 19:06:25 [INFO    ] Finished processing BAM request
2018-11-29 19:06:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668420   8 58451 68785033 A  ERROR'
2018-11-29 19:06:25 [DEBUG   ] Got command BAM from MCS: ref #668421
2018-11-29 19:06:25 [INFO    ] Finished processing BAM request
2018-11-29 19:06:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668421   8 58451 68785037 A  ERROR'
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:06:25 [DEBUG   ] spawn_process: at 2018-11-29 19:06:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:06:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:06:46 [DEBUG   ] Got command BAM from MCS: ref #668423
2018-11-29 19:06:46 [INFO    ] Finished processing BAM request
2018-11-29 19:06:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668423   8 58451 68806029 A  ERROR'
2018-11-29 19:06:46 [DEBUG   ] Got command BAM from MCS: ref #668422
2018-11-29 19:06:46 [INFO    ] Finished processing BAM request
2018-11-29 19:06:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668422   8 58451 68806033 A  ERROR'
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:06:46 [DEBUG   ] spawn_process: at 2018-11-29 19:06:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:06:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:07:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:07:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:07:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:07:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:07:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:07:03 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-29 19:07:07 [DEBUG   ] Got command BAM from MCS: ref #668424
2018-11-29 19:07:07 [INFO    ] Finished processing BAM request
2018-11-29 19:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668424   8 58451 68827029 A  ERROR'
2018-11-29 19:07:07 [DEBUG   ] Got command BAM from MCS: ref #668425
2018-11-29 19:07:07 [INFO    ] Finished processing BAM request
2018-11-29 19:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668425   8 58451 68827033 A  ERROR'
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:07:07 [DEBUG   ] spawn_process: at 2018-11-29 19:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:07:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:07:28 [DEBUG   ] Got command BAM from MCS: ref #668427
2018-11-29 19:07:28 [INFO    ] Finished processing BAM request
2018-11-29 19:07:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668427   8 58451 68848025 A  ERROR'
2018-11-29 19:07:28 [DEBUG   ] Got command BAM from MCS: ref #668426
2018-11-29 19:07:28 [INFO    ] Finished processing BAM request
2018-11-29 19:07:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668426   8 58451 68848029 A  ERROR'
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:07:28 [DEBUG   ] spawn_process: at 2018-11-29 19:07:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:07:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:07:49 [DEBUG   ] Got command BAM from MCS: ref #668429
2018-11-29 19:07:49 [INFO    ] Finished processing BAM request
2018-11-29 19:07:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:07:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668429   8 58451 68869025 A  ERROR'
2018-11-29 19:07:49 [DEBUG   ] Got command BAM from MCS: ref #668428
2018-11-29 19:07:49 [INFO    ] Finished processing BAM request
2018-11-29 19:07:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:07:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668428   8 58451 68869029 A  ERROR'
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:07:49 [DEBUG   ] spawn_process: at 2018-11-29 19:07:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:07:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:08:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:08:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:08:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:08:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:08:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:08:02 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-29 19:08:10 [DEBUG   ] Got command BAM from MCS: ref #668430
2018-11-29 19:08:10 [INFO    ] Finished processing BAM request
2018-11-29 19:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668430   8 58451 68890041 A  ERROR'
2018-11-29 19:08:10 [DEBUG   ] Got command BAM from MCS: ref #668431
2018-11-29 19:08:10 [INFO    ] Finished processing BAM request
2018-11-29 19:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668431   8 58451 68890045 A  ERROR'
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:08:10 [DEBUG   ] spawn_process: at 2018-11-29 19:08:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:08:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:08:31 [DEBUG   ] Got command BAM from MCS: ref #668436
2018-11-29 19:08:31 [INFO    ] Finished processing BAM request
2018-11-29 19:08:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668436   8 58451 68911029 A  ERROR'
2018-11-29 19:08:31 [DEBUG   ] Got command BAM from MCS: ref #668437
2018-11-29 19:08:31 [INFO    ] Finished processing BAM request
2018-11-29 19:08:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668437   8 58451 68911037 A  ERROR'
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:08:31 [DEBUG   ] spawn_process: at 2018-11-29 19:08:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:08:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:08:52 [DEBUG   ] Got command BAM from MCS: ref #668438
2018-11-29 19:08:52 [INFO    ] Finished processing BAM request
2018-11-29 19:08:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668438   8 58451 68932025 A  ERROR'
2018-11-29 19:08:52 [DEBUG   ] Got command BAM from MCS: ref #668439
2018-11-29 19:08:52 [INFO    ] Finished processing BAM request
2018-11-29 19:08:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:08:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668439   8 58451 68932029 A  ERROR'
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:08:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:08:52 [DEBUG   ] spawn_process: at 2018-11-29 19:08:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:08:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:08:59 [DEBUG   ] Got command RPT from MCS: ref #668440
2018-11-29 19:08:59 [DEBUG   ] summary = ERROR
2018-11-29 19:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668440  13 58451 68939853 A  ERRORERROR'
2018-11-29 19:09:00 [DEBUG   ] Got command RPT from MCS: ref #668441
2018-11-29 19:09:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668441  77 58451 68940057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:09:00 [DEBUG   ] Got command RPT from MCS: ref #668442
2018-11-29 19:09:00 [DEBUG   ] summary = ERROR
2018-11-29 19:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668442  13 58451 68940249 A  ERRORERROR'
2018-11-29 19:09:00 [DEBUG   ] Got command RPT from MCS: ref #668443
2018-11-29 19:09:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668443  77 58451 68940453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:09:00 [DEBUG   ] Got command RPT from MCS: ref #668444
2018-11-29 19:09:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668444  12 58451 68940657 A  ERRORB¢ff'
2018-11-29 19:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 19:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:09:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:09:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:09:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:09:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:09:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:09:03 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-11-29 19:09:12 [DEBUG   ] Got command BAM from MCS: ref #668446
2018-11-29 19:09:12 [INFO    ] Finished processing BAM request
2018-11-29 19:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668446   8 58451 68952029 A  ERROR'
2018-11-29 19:09:12 [DEBUG   ] Got command BAM from MCS: ref #668445
2018-11-29 19:09:12 [INFO    ] Finished processing BAM request
2018-11-29 19:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668445   8 58451 68952033 A  ERROR'
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:09:12 [DEBUG   ] spawn_process: at 2018-11-29 19:09:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:09:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-29 19:09:32 [DEBUG   ] Got command BAM from MCS: ref #668448
2018-11-29 19:09:32 [INFO    ] Finished processing BAM request
2018-11-29 19:09:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668448   8 58451 68972033 A  ERROR'
2018-11-29 19:09:32 [DEBUG   ] Got command BAM from MCS: ref #668447
2018-11-29 19:09:32 [INFO    ] Finished processing BAM request
2018-11-29 19:09:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668447   8 58451 68972037 A  ERROR'
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:09:32 [DEBUG   ] spawn_process: at 2018-11-29 19:09:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:09:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:09:52 [DEBUG   ] Got command BAM from MCS: ref #668449
2018-11-29 19:09:52 [INFO    ] Finished processing BAM request
2018-11-29 19:09:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668449   8 58451 68992029 A  ERROR'
2018-11-29 19:09:52 [DEBUG   ] Got command BAM from MCS: ref #668450
2018-11-29 19:09:52 [INFO    ] Finished processing BAM request
2018-11-29 19:09:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668450   8 58451 68992033 A  ERROR'
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:09:52 [DEBUG   ] spawn_process: at 2018-11-29 19:09:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:09:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-29 19:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 19:10:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:10:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:10:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:10:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:10:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:10:02 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-29 19:10:12 [DEBUG   ] Got command BAM from MCS: ref #668451
2018-11-29 19:10:12 [INFO    ] Finished processing BAM request
2018-11-29 19:10:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668451   8 58451 69012029 A  ERROR'
2018-11-29 19:10:12 [DEBUG   ] Got command BAM from MCS: ref #668452
2018-11-29 19:10:12 [INFO    ] Finished processing BAM request
2018-11-29 19:10:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668452   8 58451 69012033 A  ERROR'
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:10:12 [DEBUG   ] spawn_process: at 2018-11-29 19:10:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:10:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:10:32 [DEBUG   ] Got command BAM from MCS: ref #668453
2018-11-29 19:10:32 [INFO    ] Finished processing BAM request
2018-11-29 19:10:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668453   8 58451 69032025 A  ERROR'
2018-11-29 19:10:32 [DEBUG   ] Got command BAM from MCS: ref #668454
2018-11-29 19:10:32 [INFO    ] Finished processing BAM request
2018-11-29 19:10:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:10:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668454   8 58451 69032029 A  ERROR'
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:10:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:10:32 [DEBUG   ] spawn_process: at 2018-11-29 19:10:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:10:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:10:49 [DEBUG   ] Got command RPT from MCS: ref #668455
2018-11-29 19:10:49 [DEBUG   ] summary = ERROR
2018-11-29 19:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668455  13 58451 69049773 A  ERRORERROR'
2018-11-29 19:10:49 [DEBUG   ] Got command RPT from MCS: ref #668456
2018-11-29 19:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668456  77 58451 69049774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:10:52 [DEBUG   ] Got command BAM from MCS: ref #668472
2018-11-29 19:10:52 [INFO    ] Finished processing BAM request
2018-11-29 19:10:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:10:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668472   8 58451 69052033 A  ERROR'
2018-11-29 19:10:52 [DEBUG   ] Got command BAM from MCS: ref #668473
2018-11-29 19:10:52 [INFO    ] Finished processing BAM request
2018-11-29 19:10:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:10:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668473   8 58451 69052037 A  ERROR'
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:10:52 [DEBUG   ] spawn_process: at 2018-11-29 19:10:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:10:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:11:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:11:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:11:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:11:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:11:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:11:02 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-29 19:11:12 [DEBUG   ] Got command BAM from MCS: ref #668474
2018-11-29 19:11:12 [INFO    ] Finished processing BAM request
2018-11-29 19:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668474   8 58451 69072033 A  ERROR'
2018-11-29 19:11:12 [DEBUG   ] Got command BAM from MCS: ref #668475
2018-11-29 19:11:12 [INFO    ] Finished processing BAM request
2018-11-29 19:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668475   8 58451 69072037 A  ERROR'
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:11:12 [DEBUG   ] spawn_process: at 2018-11-29 19:11:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:11:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:11:32 [DEBUG   ] Got command BAM from MCS: ref #668480
2018-11-29 19:11:32 [INFO    ] Finished processing BAM request
2018-11-29 19:11:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668480   8 58451 69092025 A  ERROR'
2018-11-29 19:11:32 [DEBUG   ] Got command BAM from MCS: ref #668481
2018-11-29 19:11:32 [INFO    ] Finished processing BAM request
2018-11-29 19:11:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668481   8 58451 69092029 A  ERROR'
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:11:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:11:32 [DEBUG   ] spawn_process: at 2018-11-29 19:11:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:11:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:11:52 [DEBUG   ] Got command BAM from MCS: ref #668482
2018-11-29 19:11:52 [INFO    ] Finished processing BAM request
2018-11-29 19:11:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668482   8 58451 69112025 A  ERROR'
2018-11-29 19:11:52 [DEBUG   ] Got command BAM from MCS: ref #668483
2018-11-29 19:11:52 [INFO    ] Finished processing BAM request
2018-11-29 19:11:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668483   8 58451 69112029 A  ERROR'
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:11:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:11:52 [DEBUG   ] spawn_process: at 2018-11-29 19:11:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:11:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 19:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:12:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 19:12:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:12:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:12:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:12:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:12:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:12:02 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-11-29 19:12:12 [DEBUG   ] Got command BAM from MCS: ref #668485
2018-11-29 19:12:12 [INFO    ] Finished processing BAM request
2018-11-29 19:12:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668485   8 58451 69132033 A  ERROR'
2018-11-29 19:12:12 [DEBUG   ] Got command BAM from MCS: ref #668484
2018-11-29 19:12:12 [INFO    ] Finished processing BAM request
2018-11-29 19:12:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668484   8 58451 69132037 A  ERROR'
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:12:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:12:12 [DEBUG   ] spawn_process: at 2018-11-29 19:12:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:12:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:12:32 [DEBUG   ] Got command BAM from MCS: ref #668487
2018-11-29 19:12:32 [INFO    ] Finished processing BAM request
2018-11-29 19:12:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668487   8 58451 69152029 A  ERROR'
2018-11-29 19:12:32 [DEBUG   ] Got command BAM from MCS: ref #668486
2018-11-29 19:12:32 [INFO    ] Finished processing BAM request
2018-11-29 19:12:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668486   8 58451 69152033 A  ERROR'
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:12:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:12:32 [DEBUG   ] spawn_process: at 2018-11-29 19:12:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:12:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:12:52 [DEBUG   ] Got command BAM from MCS: ref #668489
2018-11-29 19:12:52 [INFO    ] Finished processing BAM request
2018-11-29 19:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668489   8 58451 69172025 A  ERROR'
2018-11-29 19:12:52 [DEBUG   ] Got command BAM from MCS: ref #668488
2018-11-29 19:12:52 [INFO    ] Finished processing BAM request
2018-11-29 19:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668488   8 58451 69172029 A  ERROR'
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:12:52 [DEBUG   ] spawn_process: at 2018-11-29 19:12:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:12:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:13:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:13:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:13:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:13:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:13:02 [WARNING ] (13, 1, 'bot')
2018-11-29 19:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:13:02 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-29 19:13:12 [DEBUG   ] Got command BAM from MCS: ref #668491
2018-11-29 19:13:12 [INFO    ] Finished processing BAM request
2018-11-29 19:13:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668491   8 58451 69192033 A  ERROR'
2018-11-29 19:13:12 [DEBUG   ] Got command BAM from MCS: ref #668490
2018-11-29 19:13:12 [INFO    ] Finished processing BAM request
2018-11-29 19:13:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668490   8 58451 69192037 A  ERROR'
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:13:12 [DEBUG   ] spawn_process: at 2018-11-29 19:13:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:13:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:13:32 [DEBUG   ] Got command BAM from MCS: ref #668492
2018-11-29 19:13:32 [INFO    ] Finished processing BAM request
2018-11-29 19:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668492   8 58451 69212025 A  ERROR'
2018-11-29 19:13:32 [DEBUG   ] Got command BAM from MCS: ref #668493
2018-11-29 19:13:32 [INFO    ] Finished processing BAM request
2018-11-29 19:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668493   8 58451 69212029 A  ERROR'
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:13:32 [DEBUG   ] spawn_process: at 2018-11-29 19:13:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:13:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:13:52 [DEBUG   ] Got command BAM from MCS: ref #668496
2018-11-29 19:13:52 [INFO    ] Finished processing BAM request
2018-11-29 19:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668496   8 58451 69232033 A  ERROR'
2018-11-29 19:13:52 [DEBUG   ] Got command BAM from MCS: ref #668497
2018-11-29 19:13:52 [INFO    ] Finished processing BAM request
2018-11-29 19:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668497   8 58451 69232037 A  ERROR'
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:13:52 [DEBUG   ] spawn_process: at 2018-11-29 19:13:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:13:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:13:59 [DEBUG   ] Got command RPT from MCS: ref #668498
2018-11-29 19:13:59 [DEBUG   ] summary = ERROR
2018-11-29 19:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668498  13 58451 69239937 A  ERRORERROR'
2018-11-29 19:14:00 [DEBUG   ] Got command RPT from MCS: ref #668499
2018-11-29 19:14:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668499  77 58451 69240141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:14:00 [DEBUG   ] Got command RPT from MCS: ref #668500
2018-11-29 19:14:00 [DEBUG   ] summary = ERROR
2018-11-29 19:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668500  13 58451 69240345 A  ERRORERROR'
2018-11-29 19:14:00 [DEBUG   ] Got command RPT from MCS: ref #668502
2018-11-29 19:14:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668502  77 58451 69240537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:14:00 [DEBUG   ] Got command RPT from MCS: ref #668504
2018-11-29 19:14:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668504  12 58451 69240741 A  ERRORB¡ff'
2018-11-29 19:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:14:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:14:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:14:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:14:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:14:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:14:03 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-29 19:14:12 [DEBUG   ] Got command BAM from MCS: ref #668508
2018-11-29 19:14:12 [INFO    ] Finished processing BAM request
2018-11-29 19:14:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668508   8 58451 69252029 A  ERROR'
2018-11-29 19:14:12 [DEBUG   ] Got command BAM from MCS: ref #668509
2018-11-29 19:14:12 [INFO    ] Finished processing BAM request
2018-11-29 19:14:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668509   8 58451 69252033 A  ERROR'
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:14:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:14:12 [DEBUG   ] spawn_process: at 2018-11-29 19:14:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:14:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:14:32 [DEBUG   ] Got command BAM from MCS: ref #668515
2018-11-29 19:14:32 [INFO    ] Finished processing BAM request
2018-11-29 19:14:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668515   8 58451 69272033 A  ERROR'
2018-11-29 19:14:32 [DEBUG   ] Got command BAM from MCS: ref #668514
2018-11-29 19:14:32 [INFO    ] Finished processing BAM request
2018-11-29 19:14:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668514   8 58451 69272037 A  ERROR'
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:14:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:14:32 [DEBUG   ] spawn_process: at 2018-11-29 19:14:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:14:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:14:52 [DEBUG   ] Got command BAM from MCS: ref #668517
2018-11-29 19:14:52 [INFO    ] Finished processing BAM request
2018-11-29 19:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668517   8 58451 69292025 A  ERROR'
2018-11-29 19:14:52 [DEBUG   ] Got command BAM from MCS: ref #668516
2018-11-29 19:14:52 [INFO    ] Finished processing BAM request
2018-11-29 19:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668516   8 58451 69292029 A  ERROR'
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:14:52 [DEBUG   ] spawn_process: at 2018-11-29 19:14:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:14:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 19:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:15:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:15:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:15:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:15:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:15:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:15:03 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-29 19:15:12 [DEBUG   ] Got command BAM from MCS: ref #668519
2018-11-29 19:15:12 [INFO    ] Finished processing BAM request
2018-11-29 19:15:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668519   8 58451 69312025 A  ERROR'
2018-11-29 19:15:12 [DEBUG   ] Got command BAM from MCS: ref #668518
2018-11-29 19:15:12 [INFO    ] Finished processing BAM request
2018-11-29 19:15:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668518   8 58451 69312029 A  ERROR'
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:15:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:15:12 [DEBUG   ] spawn_process: at 2018-11-29 19:15:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:15:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:15:32 [DEBUG   ] Got command BAM from MCS: ref #668521
2018-11-29 19:15:32 [INFO    ] Finished processing BAM request
2018-11-29 19:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668521   8 58451 69332033 A  ERROR'
2018-11-29 19:15:32 [DEBUG   ] Got command BAM from MCS: ref #668520
2018-11-29 19:15:32 [INFO    ] Finished processing BAM request
2018-11-29 19:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668520   8 58451 69332037 A  ERROR'
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:15:32 [DEBUG   ] spawn_process: at 2018-11-29 19:15:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:15:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:15:49 [DEBUG   ] Got command RPT from MCS: ref #668522
2018-11-29 19:15:49 [DEBUG   ] summary = ERROR
2018-11-29 19:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668522  13 58451 69349777 A  ERRORERROR'
2018-11-29 19:15:49 [DEBUG   ] Got command RPT from MCS: ref #668523
2018-11-29 19:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668523  77 58451 69349778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:15:52 [DEBUG   ] Got command BAM from MCS: ref #668539
2018-11-29 19:15:52 [INFO    ] Finished processing BAM request
2018-11-29 19:15:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:15:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668539   8 58451 69352025 A  ERROR'
2018-11-29 19:15:52 [DEBUG   ] Got command BAM from MCS: ref #668540
2018-11-29 19:15:52 [INFO    ] Finished processing BAM request
2018-11-29 19:15:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:15:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668540   8 58451 69352029 A  ERROR'
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:15:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:15:52 [DEBUG   ] spawn_process: at 2018-11-29 19:15:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:15:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:16:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:16:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:16:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:16:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:16:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:16:03 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-11-29 19:16:12 [DEBUG   ] Got command BAM from MCS: ref #668542
2018-11-29 19:16:12 [INFO    ] Finished processing BAM request
2018-11-29 19:16:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668542   8 58451 69372029 A  ERROR'
2018-11-29 19:16:12 [DEBUG   ] Got command BAM from MCS: ref #668541
2018-11-29 19:16:12 [INFO    ] Finished processing BAM request
2018-11-29 19:16:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668541   8 58451 69372033 A  ERROR'
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:16:12 [DEBUG   ] spawn_process: at 2018-11-29 19:16:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:16:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:16:32 [DEBUG   ] Got command BAM from MCS: ref #668543
2018-11-29 19:16:32 [INFO    ] Finished processing BAM request
2018-11-29 19:16:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668543   8 58451 69392025 A  ERROR'
2018-11-29 19:16:32 [DEBUG   ] Got command BAM from MCS: ref #668544
2018-11-29 19:16:32 [INFO    ] Finished processing BAM request
2018-11-29 19:16:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668544   8 58451 69392029 A  ERROR'
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:16:32 [DEBUG   ] spawn_process: at 2018-11-29 19:16:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:16:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:16:52 [DEBUG   ] Got command BAM from MCS: ref #668545
2018-11-29 19:16:52 [INFO    ] Finished processing BAM request
2018-11-29 19:16:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668545   8 58451 69412025 A  ERROR'
2018-11-29 19:16:52 [DEBUG   ] Got command BAM from MCS: ref #668546
2018-11-29 19:16:52 [INFO    ] Finished processing BAM request
2018-11-29 19:16:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668546   8 58451 69412029 A  ERROR'
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:16:52 [DEBUG   ] spawn_process: at 2018-11-29 19:16:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:16:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 19:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:17:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:17:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:17:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:17:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:17:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:17:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:17:04 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-11-29 19:17:12 [DEBUG   ] Got command BAM from MCS: ref #668548
2018-11-29 19:17:12 [INFO    ] Finished processing BAM request
2018-11-29 19:17:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668548   8 58451 69432025 A  ERROR'
2018-11-29 19:17:12 [DEBUG   ] Got command BAM from MCS: ref #668547
2018-11-29 19:17:12 [INFO    ] Finished processing BAM request
2018-11-29 19:17:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668547   8 58451 69432029 A  ERROR'
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:17:12 [DEBUG   ] spawn_process: at 2018-11-29 19:17:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:17:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:17:32 [DEBUG   ] Got command BAM from MCS: ref #668554
2018-11-29 19:17:32 [INFO    ] Finished processing BAM request
2018-11-29 19:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668554   8 58451 69452025 A  ERROR'
2018-11-29 19:17:32 [DEBUG   ] Got command BAM from MCS: ref #668553
2018-11-29 19:17:32 [INFO    ] Finished processing BAM request
2018-11-29 19:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668553   8 58451 69452029 A  ERROR'
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:17:32 [DEBUG   ] spawn_process: at 2018-11-29 19:17:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:17:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:17:52 [DEBUG   ] Got command BAM from MCS: ref #668556
2018-11-29 19:17:52 [INFO    ] Finished processing BAM request
2018-11-29 19:17:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:17:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668556   8 58451 69472033 A  ERROR'
2018-11-29 19:17:52 [DEBUG   ] Got command BAM from MCS: ref #668555
2018-11-29 19:17:52 [INFO    ] Finished processing BAM request
2018-11-29 19:17:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:17:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668555   8 58451 69472037 A  ERROR'
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:17:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:17:52 [DEBUG   ] spawn_process: at 2018-11-29 19:17:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:17:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-11-29 19:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:18:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:18:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:18:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:18:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:18:03 [WARNING ] (13, 1, 'bot')
2018-11-29 19:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:18:03 [DEBUG   ] Finished updating board flags in 1.276 seconds
2018-11-29 19:18:12 [DEBUG   ] Got command BAM from MCS: ref #668558
2018-11-29 19:18:12 [INFO    ] Finished processing BAM request
2018-11-29 19:18:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668558   8 58451 69492033 A  ERROR'
2018-11-29 19:18:12 [DEBUG   ] Got command BAM from MCS: ref #668557
2018-11-29 19:18:12 [INFO    ] Finished processing BAM request
2018-11-29 19:18:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668557   8 58451 69492037 A  ERROR'
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:18:12 [DEBUG   ] spawn_process: at 2018-11-29 19:18:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:18:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:18:32 [DEBUG   ] Got command BAM from MCS: ref #668559
2018-11-29 19:18:32 [INFO    ] Finished processing BAM request
2018-11-29 19:18:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668559   8 58451 69512033 A  ERROR'
2018-11-29 19:18:32 [DEBUG   ] Got command BAM from MCS: ref #668560
2018-11-29 19:18:32 [INFO    ] Finished processing BAM request
2018-11-29 19:18:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668560   8 58451 69512037 A  ERROR'
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:18:32 [DEBUG   ] spawn_process: at 2018-11-29 19:18:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:18:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:18:52 [DEBUG   ] Got command BAM from MCS: ref #668562
2018-11-29 19:18:52 [INFO    ] Finished processing BAM request
2018-11-29 19:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668562   8 58451 69532025 A  ERROR'
2018-11-29 19:18:52 [DEBUG   ] Got command BAM from MCS: ref #668561
2018-11-29 19:18:52 [INFO    ] Finished processing BAM request
2018-11-29 19:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668561   8 58451 69532029 A  ERROR'
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:18:52 [DEBUG   ] spawn_process: at 2018-11-29 19:18:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:18:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:19:00 [DEBUG   ] Got command RPT from MCS: ref #668563
2018-11-29 19:19:00 [DEBUG   ] summary = ERROR
2018-11-29 19:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668563  13 58451 69540033 A  ERRORERROR'
2018-11-29 19:19:00 [DEBUG   ] Got command RPT from MCS: ref #668564
2018-11-29 19:19:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668564  77 58451 69540225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:19:00 [DEBUG   ] Got command RPT from MCS: ref #668565
2018-11-29 19:19:00 [DEBUG   ] summary = ERROR
2018-11-29 19:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668565  13 58451 69540429 A  ERRORERROR'
2018-11-29 19:19:00 [DEBUG   ] Got command RPT from MCS: ref #668566
2018-11-29 19:19:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668566  77 58451 69540633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:19:00 [DEBUG   ] Got command RPT from MCS: ref #668567
2018-11-29 19:19:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668567  12 58451 69540825 A  ERRORB£ff'
2018-11-29 19:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:19:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:19:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:19:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:19:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:19:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:19:04 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-11-29 19:19:12 [DEBUG   ] Got command BAM from MCS: ref #668569
2018-11-29 19:19:12 [INFO    ] Finished processing BAM request
2018-11-29 19:19:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668569   8 58451 69552033 A  ERROR'
2018-11-29 19:19:12 [DEBUG   ] Got command BAM from MCS: ref #668568
2018-11-29 19:19:12 [INFO    ] Finished processing BAM request
2018-11-29 19:19:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668568   8 58451 69552037 A  ERROR'
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:19:12 [DEBUG   ] spawn_process: at 2018-11-29 19:19:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:19:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:19:32 [DEBUG   ] Got command BAM from MCS: ref #668570
2018-11-29 19:19:32 [INFO    ] Finished processing BAM request
2018-11-29 19:19:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668570   8 58451 69572033 A  ERROR'
2018-11-29 19:19:32 [DEBUG   ] Got command BAM from MCS: ref #668571
2018-11-29 19:19:32 [INFO    ] Finished processing BAM request
2018-11-29 19:19:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668571   8 58451 69572037 A  ERROR'
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:19:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:19:32 [DEBUG   ] spawn_process: at 2018-11-29 19:19:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:19:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:19:52 [DEBUG   ] Got command BAM from MCS: ref #668572
2018-11-29 19:19:52 [INFO    ] Finished processing BAM request
2018-11-29 19:19:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668572   8 58451 69592025 A  ERROR'
2018-11-29 19:19:52 [DEBUG   ] Got command BAM from MCS: ref #668573
2018-11-29 19:19:52 [INFO    ] Finished processing BAM request
2018-11-29 19:19:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668573   8 58451 69592029 A  ERROR'
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:19:52 [DEBUG   ] spawn_process: at 2018-11-29 19:19:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:19:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 19:20:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:20:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:20:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:20:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:20:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:20:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:20:04 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-11-29 19:20:12 [DEBUG   ] Got command BAM from MCS: ref #668575
2018-11-29 19:20:12 [INFO    ] Finished processing BAM request
2018-11-29 19:20:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668575   8 58451 69612033 A  ERROR'
2018-11-29 19:20:12 [DEBUG   ] Got command BAM from MCS: ref #668574
2018-11-29 19:20:12 [INFO    ] Finished processing BAM request
2018-11-29 19:20:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668574   8 58451 69612037 A  ERROR'
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:20:12 [DEBUG   ] spawn_process: at 2018-11-29 19:20:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:20:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:20:32 [DEBUG   ] Got command BAM from MCS: ref #668581
2018-11-29 19:20:32 [INFO    ] Finished processing BAM request
2018-11-29 19:20:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:20:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668581   8 58451 69632025 A  ERROR'
2018-11-29 19:20:32 [DEBUG   ] Got command BAM from MCS: ref #668580
2018-11-29 19:20:32 [INFO    ] Finished processing BAM request
2018-11-29 19:20:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:20:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668580   8 58451 69632029 A  ERROR'
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:20:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:20:32 [DEBUG   ] spawn_process: at 2018-11-29 19:20:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:20:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:20:49 [DEBUG   ] Got command RPT from MCS: ref #668582
2018-11-29 19:20:49 [DEBUG   ] summary = ERROR
2018-11-29 19:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668582  13 58451 69649777 A  ERRORERROR'
2018-11-29 19:20:49 [DEBUG   ] Got command RPT from MCS: ref #668583
2018-11-29 19:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668583  77 58451 69649778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:20:52 [DEBUG   ] Got command BAM from MCS: ref #668600
2018-11-29 19:20:52 [INFO    ] Finished processing BAM request
2018-11-29 19:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668600   8 58451 69652025 A  ERROR'
2018-11-29 19:20:52 [DEBUG   ] Got command BAM from MCS: ref #668599
2018-11-29 19:20:52 [INFO    ] Finished processing BAM request
2018-11-29 19:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668599   8 58451 69652029 A  ERROR'
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:20:52 [DEBUG   ] spawn_process: at 2018-11-29 19:20:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:20:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:21:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:21:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:21:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:21:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:21:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:21:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:21:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:21:04 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-29 19:21:12 [DEBUG   ] Got command BAM from MCS: ref #668601
2018-11-29 19:21:12 [INFO    ] Finished processing BAM request
2018-11-29 19:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668601   8 58451 69672033 A  ERROR'
2018-11-29 19:21:12 [DEBUG   ] Got command BAM from MCS: ref #668602
2018-11-29 19:21:12 [INFO    ] Finished processing BAM request
2018-11-29 19:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668602   8 58451 69672037 A  ERROR'
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:21:12 [DEBUG   ] spawn_process: at 2018-11-29 19:21:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:21:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:21:32 [DEBUG   ] Got command BAM from MCS: ref #668604
2018-11-29 19:21:32 [INFO    ] Finished processing BAM request
2018-11-29 19:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668604   8 58451 69692025 A  ERROR'
2018-11-29 19:21:32 [DEBUG   ] Got command BAM from MCS: ref #668603
2018-11-29 19:21:32 [INFO    ] Finished processing BAM request
2018-11-29 19:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668603   8 58451 69692029 A  ERROR'
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:21:32 [DEBUG   ] spawn_process: at 2018-11-29 19:21:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:21:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:21:52 [DEBUG   ] Got command BAM from MCS: ref #668606
2018-11-29 19:21:52 [INFO    ] Finished processing BAM request
2018-11-29 19:21:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668606   8 58451 69712025 A  ERROR'
2018-11-29 19:21:52 [DEBUG   ] Got command BAM from MCS: ref #668605
2018-11-29 19:21:52 [INFO    ] Finished processing BAM request
2018-11-29 19:21:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668605   8 58451 69712029 A  ERROR'
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:21:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:21:52 [DEBUG   ] spawn_process: at 2018-11-29 19:21:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:21:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-11-29 19:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 19:22:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:22:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:22:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:22:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:22:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:22:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:22:04 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-11-29 19:22:12 [DEBUG   ] Got command BAM from MCS: ref #668607
2018-11-29 19:22:12 [INFO    ] Finished processing BAM request
2018-11-29 19:22:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668607   8 58451 69732033 A  ERROR'
2018-11-29 19:22:12 [DEBUG   ] Got command BAM from MCS: ref #668608
2018-11-29 19:22:12 [INFO    ] Finished processing BAM request
2018-11-29 19:22:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668608   8 58451 69732037 A  ERROR'
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:22:12 [DEBUG   ] spawn_process: at 2018-11-29 19:22:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:22:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:22:32 [DEBUG   ] Got command BAM from MCS: ref #668609
2018-11-29 19:22:32 [INFO    ] Finished processing BAM request
2018-11-29 19:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668609   8 58451 69752033 A  ERROR'
2018-11-29 19:22:32 [DEBUG   ] Got command BAM from MCS: ref #668610
2018-11-29 19:22:32 [INFO    ] Finished processing BAM request
2018-11-29 19:22:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668610   8 58451 69752037 A  ERROR'
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:22:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:22:32 [DEBUG   ] spawn_process: at 2018-11-29 19:22:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:22:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:22:52 [DEBUG   ] Got command BAM from MCS: ref #668612
2018-11-29 19:22:52 [INFO    ] Finished processing BAM request
2018-11-29 19:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668612   8 58451 69772025 A  ERROR'
2018-11-29 19:22:52 [DEBUG   ] Got command BAM from MCS: ref #668611
2018-11-29 19:22:52 [INFO    ] Finished processing BAM request
2018-11-29 19:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668611   8 58451 69772029 A  ERROR'
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:22:52 [DEBUG   ] spawn_process: at 2018-11-29 19:22:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:22:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:23:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:23:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:23:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:23:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:23:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:23:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:23:04 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-29 19:23:12 [DEBUG   ] Got command BAM from MCS: ref #668613
2018-11-29 19:23:12 [INFO    ] Finished processing BAM request
2018-11-29 19:23:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668613   8 58451 69792029 A  ERROR'
2018-11-29 19:23:12 [DEBUG   ] Got command BAM from MCS: ref #668614
2018-11-29 19:23:12 [INFO    ] Finished processing BAM request
2018-11-29 19:23:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668614   8 58451 69792033 A  ERROR'
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:23:12 [DEBUG   ] spawn_process: at 2018-11-29 19:23:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:23:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:23:32 [DEBUG   ] Got command BAM from MCS: ref #668620
2018-11-29 19:23:32 [INFO    ] Finished processing BAM request
2018-11-29 19:23:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668620   8 58451 69812033 A  ERROR'
2018-11-29 19:23:32 [DEBUG   ] Got command BAM from MCS: ref #668619
2018-11-29 19:23:32 [INFO    ] Finished processing BAM request
2018-11-29 19:23:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668619   8 58451 69812037 A  ERROR'
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:23:32 [DEBUG   ] spawn_process: at 2018-11-29 19:23:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:23:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:23:52 [DEBUG   ] Got command BAM from MCS: ref #668623
2018-11-29 19:23:52 [INFO    ] Finished processing BAM request
2018-11-29 19:23:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668623   8 58451 69832025 A  ERROR'
2018-11-29 19:23:52 [DEBUG   ] Got command BAM from MCS: ref #668624
2018-11-29 19:23:52 [INFO    ] Finished processing BAM request
2018-11-29 19:23:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668624   8 58451 69832029 A  ERROR'
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:23:52 [DEBUG   ] spawn_process: at 2018-11-29 19:23:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:23:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:24:00 [DEBUG   ] Got command RPT from MCS: ref #668625
2018-11-29 19:24:00 [DEBUG   ] summary = ERROR
2018-11-29 19:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668625  13 58451 69840113 A  ERRORERROR'
2018-11-29 19:24:00 [DEBUG   ] Got command RPT from MCS: ref #668626
2018-11-29 19:24:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668626  77 58451 69840317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:24:00 [DEBUG   ] Got command RPT from MCS: ref #668627
2018-11-29 19:24:00 [DEBUG   ] summary = ERROR
2018-11-29 19:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668627  13 58451 69840521 A  ERRORERROR'
2018-11-29 19:24:00 [DEBUG   ] Got command RPT from MCS: ref #668629
2018-11-29 19:24:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668629  77 58451 69840713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:24:00 [DEBUG   ] Got command RPT from MCS: ref #668631
2018-11-29 19:24:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668631  12 58451 69840917 A  ERRORB£ff'
2018-11-29 19:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:24:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:24:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:24:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:24:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:24:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:24:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:24:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:24:05 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-29 19:24:12 [DEBUG   ] Got command BAM from MCS: ref #668635
2018-11-29 19:24:12 [INFO    ] Finished processing BAM request
2018-11-29 19:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668635   8 58451 69852029 A  ERROR'
2018-11-29 19:24:12 [DEBUG   ] Got command BAM from MCS: ref #668636
2018-11-29 19:24:12 [INFO    ] Finished processing BAM request
2018-11-29 19:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668636   8 58451 69852033 A  ERROR'
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:24:12 [DEBUG   ] spawn_process: at 2018-11-29 19:24:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:24:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:24:32 [DEBUG   ] Got command BAM from MCS: ref #668637
2018-11-29 19:24:32 [INFO    ] Finished processing BAM request
2018-11-29 19:24:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668637   8 58451 69872033 A  ERROR'
2018-11-29 19:24:32 [DEBUG   ] Got command BAM from MCS: ref #668638
2018-11-29 19:24:32 [INFO    ] Finished processing BAM request
2018-11-29 19:24:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668638   8 58451 69872037 A  ERROR'
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:24:32 [DEBUG   ] spawn_process: at 2018-11-29 19:24:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:24:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:24:52 [DEBUG   ] Got command BAM from MCS: ref #668639
2018-11-29 19:24:52 [INFO    ] Finished processing BAM request
2018-11-29 19:24:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668639   8 58451 69892033 A  ERROR'
2018-11-29 19:24:52 [DEBUG   ] Got command BAM from MCS: ref #668640
2018-11-29 19:24:52 [INFO    ] Finished processing BAM request
2018-11-29 19:24:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668640   8 58451 69892037 A  ERROR'
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:24:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:24:52 [DEBUG   ] spawn_process: at 2018-11-29 19:24:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:24:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 19:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 19:25:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:25:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 19:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:25:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:25:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:25:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:25:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:25:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:25:05 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-29 19:25:12 [DEBUG   ] Got command BAM from MCS: ref #668641
2018-11-29 19:25:12 [INFO    ] Finished processing BAM request
2018-11-29 19:25:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668641   8 58451 69912029 A  ERROR'
2018-11-29 19:25:12 [DEBUG   ] Got command BAM from MCS: ref #668642
2018-11-29 19:25:12 [INFO    ] Finished processing BAM request
2018-11-29 19:25:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668642   8 58451 69912033 A  ERROR'
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:25:12 [DEBUG   ] spawn_process: at 2018-11-29 19:25:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:25:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:25:32 [DEBUG   ] Got command BAM from MCS: ref #668643
2018-11-29 19:25:32 [INFO    ] Finished processing BAM request
2018-11-29 19:25:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668643   8 58451 69932029 A  ERROR'
2018-11-29 19:25:32 [DEBUG   ] Got command BAM from MCS: ref #668644
2018-11-29 19:25:32 [INFO    ] Finished processing BAM request
2018-11-29 19:25:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668644   8 58451 69932033 A  ERROR'
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:25:32 [DEBUG   ] spawn_process: at 2018-11-29 19:25:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:25:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:25:49 [DEBUG   ] Got command RPT from MCS: ref #668645
2018-11-29 19:25:49 [DEBUG   ] summary = ERROR
2018-11-29 19:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668645  13 58451 69949777 A  ERRORERROR'
2018-11-29 19:25:49 [DEBUG   ] Got command RPT from MCS: ref #668646
2018-11-29 19:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668646  77 58451 69949778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:25:52 [DEBUG   ] Got command BAM from MCS: ref #668663
2018-11-29 19:25:52 [INFO    ] Finished processing BAM request
2018-11-29 19:25:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:25:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668663   8 58451 69952025 A  ERROR'
2018-11-29 19:25:52 [DEBUG   ] Got command BAM from MCS: ref #668662
2018-11-29 19:25:52 [INFO    ] Finished processing BAM request
2018-11-29 19:25:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:25:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668662   8 58451 69952029 A  ERROR'
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:25:52 [DEBUG   ] spawn_process: at 2018-11-29 19:25:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:25:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:26:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:26:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:26:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:26:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:26:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:26:04 [DEBUG   ] Finished updating board flags in 1.250 seconds
2018-11-29 19:26:12 [DEBUG   ] Got command BAM from MCS: ref #668665
2018-11-29 19:26:12 [INFO    ] Finished processing BAM request
2018-11-29 19:26:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668665   8 58451 69972029 A  ERROR'
2018-11-29 19:26:12 [DEBUG   ] Got command BAM from MCS: ref #668664
2018-11-29 19:26:12 [INFO    ] Finished processing BAM request
2018-11-29 19:26:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668664   8 58451 69972033 A  ERROR'
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:26:12 [DEBUG   ] spawn_process: at 2018-11-29 19:26:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:26:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:26:32 [DEBUG   ] Got command BAM from MCS: ref #668670
2018-11-29 19:26:32 [INFO    ] Finished processing BAM request
2018-11-29 19:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668670   8 58451 69992025 A  ERROR'
2018-11-29 19:26:32 [DEBUG   ] Got command BAM from MCS: ref #668671
2018-11-29 19:26:32 [INFO    ] Finished processing BAM request
2018-11-29 19:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668671   8 58451 69992029 A  ERROR'
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:26:32 [DEBUG   ] spawn_process: at 2018-11-29 19:26:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:26:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-29 19:26:52 [DEBUG   ] Got command BAM from MCS: ref #668673
2018-11-29 19:26:52 [INFO    ] Finished processing BAM request
2018-11-29 19:26:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668673   8 58451 70012025 A  ERROR'
2018-11-29 19:26:52 [DEBUG   ] Got command BAM from MCS: ref #668672
2018-11-29 19:26:52 [INFO    ] Finished processing BAM request
2018-11-29 19:26:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668672   8 58451 70012029 A  ERROR'
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:26:52 [DEBUG   ] spawn_process: at 2018-11-29 19:26:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:26:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:27:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:27:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:27:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:27:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:27:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:27:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:27:05 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-11-29 19:27:12 [DEBUG   ] Got command BAM from MCS: ref #668675
2018-11-29 19:27:12 [INFO    ] Finished processing BAM request
2018-11-29 19:27:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668675   8 58451 70032029 A  ERROR'
2018-11-29 19:27:12 [DEBUG   ] Got command BAM from MCS: ref #668674
2018-11-29 19:27:12 [INFO    ] Finished processing BAM request
2018-11-29 19:27:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668674   8 58451 70032033 A  ERROR'
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:27:12 [DEBUG   ] spawn_process: at 2018-11-29 19:27:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:27:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:27:32 [DEBUG   ] Got command BAM from MCS: ref #668677
2018-11-29 19:27:32 [INFO    ] Finished processing BAM request
2018-11-29 19:27:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668677   8 58451 70052033 A  ERROR'
2018-11-29 19:27:32 [DEBUG   ] Got command BAM from MCS: ref #668676
2018-11-29 19:27:32 [INFO    ] Finished processing BAM request
2018-11-29 19:27:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668676   8 58451 70052037 A  ERROR'
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:27:32 [DEBUG   ] spawn_process: at 2018-11-29 19:27:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:27:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:27:52 [DEBUG   ] Got command BAM from MCS: ref #668678
2018-11-29 19:27:52 [INFO    ] Finished processing BAM request
2018-11-29 19:27:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:27:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668678   8 58451 70072029 A  ERROR'
2018-11-29 19:27:52 [DEBUG   ] Got command BAM from MCS: ref #668679
2018-11-29 19:27:52 [INFO    ] Finished processing BAM request
2018-11-29 19:27:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:27:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668679   8 58451 70072033 A  ERROR'
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:27:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:27:52 [DEBUG   ] spawn_process: at 2018-11-29 19:27:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:27:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:28:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:28:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:28:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:28:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:28:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:28:04 [WARNING ] (13, 1, 'bot')
2018-11-29 19:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:28:04 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-29 19:28:12 [DEBUG   ] Got command BAM from MCS: ref #668680
2018-11-29 19:28:12 [INFO    ] Finished processing BAM request
2018-11-29 19:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668680   8 58451 70092029 A  ERROR'
2018-11-29 19:28:12 [DEBUG   ] Got command BAM from MCS: ref #668681
2018-11-29 19:28:12 [INFO    ] Finished processing BAM request
2018-11-29 19:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668681   8 58451 70092033 A  ERROR'
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:28:12 [DEBUG   ] spawn_process: at 2018-11-29 19:28:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:28:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:28:32 [DEBUG   ] Got command BAM from MCS: ref #668683
2018-11-29 19:28:32 [INFO    ] Finished processing BAM request
2018-11-29 19:28:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668683   8 58451 70112029 A  ERROR'
2018-11-29 19:28:32 [DEBUG   ] Got command BAM from MCS: ref #668682
2018-11-29 19:28:32 [INFO    ] Finished processing BAM request
2018-11-29 19:28:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668682   8 58451 70112033 A  ERROR'
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:28:32 [DEBUG   ] spawn_process: at 2018-11-29 19:28:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:28:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:28:52 [DEBUG   ] Got command BAM from MCS: ref #668685
2018-11-29 19:28:52 [INFO    ] Finished processing BAM request
2018-11-29 19:28:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668685   8 58451 70132029 A  ERROR'
2018-11-29 19:28:52 [DEBUG   ] Got command BAM from MCS: ref #668684
2018-11-29 19:28:52 [INFO    ] Finished processing BAM request
2018-11-29 19:28:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668684   8 58451 70132033 A  ERROR'
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:28:52 [DEBUG   ] spawn_process: at 2018-11-29 19:28:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:28:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:29:00 [DEBUG   ] Got command RPT from MCS: ref #668686
2018-11-29 19:29:00 [DEBUG   ] summary = ERROR
2018-11-29 19:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668686  13 58451 70140197 A  ERRORERROR'
2018-11-29 19:29:00 [DEBUG   ] Got command RPT from MCS: ref #668687
2018-11-29 19:29:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668687  77 58451 70140401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:29:00 [DEBUG   ] Got command RPT from MCS: ref #668688
2018-11-29 19:29:00 [DEBUG   ] summary = ERROR
2018-11-29 19:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668688  13 58451 70140605 A  ERRORERROR'
2018-11-29 19:29:00 [DEBUG   ] Got command RPT from MCS: ref #668689
2018-11-29 19:29:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668689  77 58451 70140809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:29:01 [DEBUG   ] Got command RPT from MCS: ref #668690
2018-11-29 19:29:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668690  12 58451 70141001 A  ERRORB¢ff'
2018-11-29 19:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:29:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:29:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:29:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:29:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:29:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:29:05 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-29 19:29:12 [DEBUG   ] Got command BAM from MCS: ref #668692
2018-11-29 19:29:12 [INFO    ] Finished processing BAM request
2018-11-29 19:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668692   8 58451 70152029 A  ERROR'
2018-11-29 19:29:12 [DEBUG   ] Got command BAM from MCS: ref #668691
2018-11-29 19:29:12 [INFO    ] Finished processing BAM request
2018-11-29 19:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668691   8 58451 70152033 A  ERROR'
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:29:12 [DEBUG   ] spawn_process: at 2018-11-29 19:29:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:29:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:29:32 [DEBUG   ] Got command BAM from MCS: ref #668698
2018-11-29 19:29:32 [INFO    ] Finished processing BAM request
2018-11-29 19:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668698   8 58451 70172033 A  ERROR'
2018-11-29 19:29:32 [DEBUG   ] Got command BAM from MCS: ref #668697
2018-11-29 19:29:32 [INFO    ] Finished processing BAM request
2018-11-29 19:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668697   8 58451 70172037 A  ERROR'
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:29:32 [DEBUG   ] spawn_process: at 2018-11-29 19:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:29:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:29:52 [DEBUG   ] Got command BAM from MCS: ref #668700
2018-11-29 19:29:52 [INFO    ] Finished processing BAM request
2018-11-29 19:29:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668700   8 58451 70192033 A  ERROR'
2018-11-29 19:29:52 [DEBUG   ] Got command BAM from MCS: ref #668699
2018-11-29 19:29:52 [INFO    ] Finished processing BAM request
2018-11-29 19:29:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668699   8 58451 70192037 A  ERROR'
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:29:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:29:52 [DEBUG   ] spawn_process: at 2018-11-29 19:29:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:29:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:30:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:30:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:30:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:30:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:30:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:30:05 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-29 19:30:12 [DEBUG   ] Got command BAM from MCS: ref #668702
2018-11-29 19:30:12 [INFO    ] Finished processing BAM request
2018-11-29 19:30:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668702   8 58451 70212029 A  ERROR'
2018-11-29 19:30:12 [DEBUG   ] Got command BAM from MCS: ref #668701
2018-11-29 19:30:12 [INFO    ] Finished processing BAM request
2018-11-29 19:30:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668701   8 58451 70212033 A  ERROR'
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:30:12 [DEBUG   ] spawn_process: at 2018-11-29 19:30:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:30:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 19:30:32 [DEBUG   ] Got command BAM from MCS: ref #668704
2018-11-29 19:30:32 [INFO    ] Finished processing BAM request
2018-11-29 19:30:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668704   8 58451 70232029 A  ERROR'
2018-11-29 19:30:32 [DEBUG   ] Got command BAM from MCS: ref #668703
2018-11-29 19:30:32 [INFO    ] Finished processing BAM request
2018-11-29 19:30:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668703   8 58451 70232033 A  ERROR'
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:30:32 [DEBUG   ] spawn_process: at 2018-11-29 19:30:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:30:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-29 19:30:49 [DEBUG   ] Got command RPT from MCS: ref #668705
2018-11-29 19:30:49 [DEBUG   ] summary = ERROR
2018-11-29 19:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668705  13 58451 70249781 A  ERRORERROR'
2018-11-29 19:30:49 [DEBUG   ] Got command RPT from MCS: ref #668706
2018-11-29 19:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668706  77 58451 70249782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:30:52 [DEBUG   ] Got command BAM from MCS: ref #668723
2018-11-29 19:30:52 [INFO    ] Finished processing BAM request
2018-11-29 19:30:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:30:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668723   8 58451 70252029 A  ERROR'
2018-11-29 19:30:52 [DEBUG   ] Got command BAM from MCS: ref #668722
2018-11-29 19:30:52 [INFO    ] Finished processing BAM request
2018-11-29 19:30:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:30:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668722   8 58451 70252033 A  ERROR'
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:30:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:30:52 [DEBUG   ] spawn_process: at 2018-11-29 19:30:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:30:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:31:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:31:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:31:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:31:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:31:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:31:05 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-29 19:31:12 [DEBUG   ] Got command BAM from MCS: ref #668725
2018-11-29 19:31:12 [INFO    ] Finished processing BAM request
2018-11-29 19:31:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668725   8 58451 70272029 A  ERROR'
2018-11-29 19:31:12 [DEBUG   ] Got command BAM from MCS: ref #668724
2018-11-29 19:31:12 [INFO    ] Finished processing BAM request
2018-11-29 19:31:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668724   8 58451 70272033 A  ERROR'
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:31:12 [DEBUG   ] spawn_process: at 2018-11-29 19:31:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:31:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:31:32 [DEBUG   ] Got command BAM from MCS: ref #668726
2018-11-29 19:31:32 [INFO    ] Finished processing BAM request
2018-11-29 19:31:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668726   8 58451 70292025 A  ERROR'
2018-11-29 19:31:32 [DEBUG   ] Got command BAM from MCS: ref #668727
2018-11-29 19:31:32 [INFO    ] Finished processing BAM request
2018-11-29 19:31:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668727   8 58451 70292029 A  ERROR'
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:31:32 [DEBUG   ] spawn_process: at 2018-11-29 19:31:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:31:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:31:52 [DEBUG   ] Got command BAM from MCS: ref #668728
2018-11-29 19:31:52 [INFO    ] Finished processing BAM request
2018-11-29 19:31:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668728   8 58451 70312033 A  ERROR'
2018-11-29 19:31:52 [DEBUG   ] Got command BAM from MCS: ref #668729
2018-11-29 19:31:52 [INFO    ] Finished processing BAM request
2018-11-29 19:31:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668729   8 58451 70312037 A  ERROR'
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:31:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:31:52 [DEBUG   ] spawn_process: at 2018-11-29 19:31:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:31:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:32:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:32:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:32:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:32:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 19:32:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:32:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:32:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:32:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:32:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:32:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:32:05 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-29 19:32:12 [DEBUG   ] Got command BAM from MCS: ref #668731
2018-11-29 19:32:12 [INFO    ] Finished processing BAM request
2018-11-29 19:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668731   8 58451 70332033 A  ERROR'
2018-11-29 19:32:12 [DEBUG   ] Got command BAM from MCS: ref #668730
2018-11-29 19:32:12 [INFO    ] Finished processing BAM request
2018-11-29 19:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668730   8 58451 70332037 A  ERROR'
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:32:12 [DEBUG   ] spawn_process: at 2018-11-29 19:32:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:32:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:32:32 [DEBUG   ] Got command BAM from MCS: ref #668737
2018-11-29 19:32:32 [INFO    ] Finished processing BAM request
2018-11-29 19:32:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668737   8 58451 70352033 A  ERROR'
2018-11-29 19:32:32 [DEBUG   ] Got command BAM from MCS: ref #668736
2018-11-29 19:32:32 [INFO    ] Finished processing BAM request
2018-11-29 19:32:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668736   8 58451 70352037 A  ERROR'
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:32:32 [DEBUG   ] spawn_process: at 2018-11-29 19:32:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:32:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:32:52 [DEBUG   ] Got command BAM from MCS: ref #668739
2018-11-29 19:32:52 [INFO    ] Finished processing BAM request
2018-11-29 19:32:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:32:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668739   8 58451 70372033 A  ERROR'
2018-11-29 19:32:52 [DEBUG   ] Got command BAM from MCS: ref #668738
2018-11-29 19:32:52 [INFO    ] Finished processing BAM request
2018-11-29 19:32:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:32:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668738   8 58451 70372037 A  ERROR'
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:32:52 [DEBUG   ] spawn_process: at 2018-11-29 19:32:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:32:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:33:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 19:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:33:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:33:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:33:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:33:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:33:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:33:06 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-11-29 19:33:12 [DEBUG   ] Got command BAM from MCS: ref #668741
2018-11-29 19:33:12 [INFO    ] Finished processing BAM request
2018-11-29 19:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668741   8 58451 70392029 A  ERROR'
2018-11-29 19:33:12 [DEBUG   ] Got command BAM from MCS: ref #668740
2018-11-29 19:33:12 [INFO    ] Finished processing BAM request
2018-11-29 19:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668740   8 58451 70392033 A  ERROR'
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:33:12 [DEBUG   ] spawn_process: at 2018-11-29 19:33:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:33:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 19:33:32 [DEBUG   ] Got command BAM from MCS: ref #668742
2018-11-29 19:33:32 [INFO    ] Finished processing BAM request
2018-11-29 19:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668742   8 58451 70412025 A  ERROR'
2018-11-29 19:33:32 [DEBUG   ] Got command BAM from MCS: ref #668743
2018-11-29 19:33:32 [INFO    ] Finished processing BAM request
2018-11-29 19:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668743   8 58451 70412029 A  ERROR'
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:33:32 [DEBUG   ] spawn_process: at 2018-11-29 19:33:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:33:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:33:52 [DEBUG   ] Got command BAM from MCS: ref #668747
2018-11-29 19:33:52 [INFO    ] Finished processing BAM request
2018-11-29 19:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668747   8 58451 70432025 A  ERROR'
2018-11-29 19:33:52 [DEBUG   ] Got command BAM from MCS: ref #668746
2018-11-29 19:33:52 [INFO    ] Finished processing BAM request
2018-11-29 19:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668746   8 58451 70432029 A  ERROR'
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:33:52 [DEBUG   ] spawn_process: at 2018-11-29 19:33:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:33:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:34:00 [DEBUG   ] Got command RPT from MCS: ref #668748
2018-11-29 19:34:00 [DEBUG   ] summary = ERROR
2018-11-29 19:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668748  13 58451 70440285 A  ERRORERROR'
2018-11-29 19:34:00 [DEBUG   ] Got command RPT from MCS: ref #668749
2018-11-29 19:34:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668749  77 58451 70440489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:34:00 [DEBUG   ] Got command RPT from MCS: ref #668750
2018-11-29 19:34:00 [DEBUG   ] summary = ERROR
2018-11-29 19:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668750  13 58451 70440693 A  ERRORERROR'
2018-11-29 19:34:00 [DEBUG   ] Got command RPT from MCS: ref #668752
2018-11-29 19:34:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668752  77 58451 70440897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:34:01 [DEBUG   ] Got command RPT from MCS: ref #668753
2018-11-29 19:34:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668753  12 58451 70441089 A  ERRORB£ff'
2018-11-29 19:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 19:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 19:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:34:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:34:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:34:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:34:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:34:05 [WARNING ] (13, 1, 'bot')
2018-11-29 19:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:34:05 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-29 19:34:12 [DEBUG   ] Got command BAM from MCS: ref #668758
2018-11-29 19:34:12 [INFO    ] Finished processing BAM request
2018-11-29 19:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668758   8 58451 70452029 A  ERROR'
2018-11-29 19:34:12 [DEBUG   ] Got command BAM from MCS: ref #668759
2018-11-29 19:34:12 [INFO    ] Finished processing BAM request
2018-11-29 19:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668759   8 58451 70452033 A  ERROR'
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:34:12 [DEBUG   ] spawn_process: at 2018-11-29 19:34:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:34:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:34:32 [DEBUG   ] Got command BAM from MCS: ref #668760
2018-11-29 19:34:32 [INFO    ] Finished processing BAM request
2018-11-29 19:34:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668760   8 58451 70472025 A  ERROR'
2018-11-29 19:34:32 [DEBUG   ] Got command BAM from MCS: ref #668761
2018-11-29 19:34:32 [INFO    ] Finished processing BAM request
2018-11-29 19:34:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668761   8 58451 70472029 A  ERROR'
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:34:32 [DEBUG   ] spawn_process: at 2018-11-29 19:34:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:34:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:34:52 [DEBUG   ] Got command BAM from MCS: ref #668762
2018-11-29 19:34:52 [INFO    ] Finished processing BAM request
2018-11-29 19:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668762   8 58451 70492025 A  ERROR'
2018-11-29 19:34:52 [DEBUG   ] Got command BAM from MCS: ref #668763
2018-11-29 19:34:52 [INFO    ] Finished processing BAM request
2018-11-29 19:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668763   8 58451 70492029 A  ERROR'
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:34:52 [DEBUG   ] spawn_process: at 2018-11-29 19:34:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:34:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:35:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:35:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:35:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:35:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:35:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:35:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:35:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:35:06 [DEBUG   ] Finished updating board flags in 1.768 seconds
2018-11-29 19:35:12 [DEBUG   ] Got command BAM from MCS: ref #668765
2018-11-29 19:35:12 [INFO    ] Finished processing BAM request
2018-11-29 19:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668765   8 58451 70512025 A  ERROR'
2018-11-29 19:35:12 [DEBUG   ] Got command BAM from MCS: ref #668764
2018-11-29 19:35:12 [INFO    ] Finished processing BAM request
2018-11-29 19:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668764   8 58451 70512029 A  ERROR'
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:35:12 [DEBUG   ] spawn_process: at 2018-11-29 19:35:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:35:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:35:32 [DEBUG   ] Got command BAM from MCS: ref #668771
2018-11-29 19:35:32 [INFO    ] Finished processing BAM request
2018-11-29 19:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668771   8 58451 70532025 A  ERROR'
2018-11-29 19:35:32 [DEBUG   ] Got command BAM from MCS: ref #668770
2018-11-29 19:35:32 [INFO    ] Finished processing BAM request
2018-11-29 19:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668770   8 58451 70532029 A  ERROR'
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:35:32 [DEBUG   ] spawn_process: at 2018-11-29 19:35:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:35:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:35:49 [DEBUG   ] Got command RPT from MCS: ref #668772
2018-11-29 19:35:49 [DEBUG   ] summary = ERROR
2018-11-29 19:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668772  13 58451 70549777 A  ERRORERROR'
2018-11-29 19:35:49 [DEBUG   ] Got command RPT from MCS: ref #668773
2018-11-29 19:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668773  77 58451 70549778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:35:52 [DEBUG   ] Got command BAM from MCS: ref #668789
2018-11-29 19:35:52 [INFO    ] Finished processing BAM request
2018-11-29 19:35:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:35:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668789   8 58451 70552025 A  ERROR'
2018-11-29 19:35:52 [DEBUG   ] Got command BAM from MCS: ref #668790
2018-11-29 19:35:52 [INFO    ] Finished processing BAM request
2018-11-29 19:35:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:35:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668790   8 58451 70552029 A  ERROR'
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:35:52 [DEBUG   ] spawn_process: at 2018-11-29 19:35:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:35:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 19:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:36:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:36:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:36:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:36:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:36:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:36:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:36:06 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-29 19:36:13 [DEBUG   ] Got command BAM from MCS: ref #668792
2018-11-29 19:36:13 [INFO    ] Finished processing BAM request
2018-11-29 19:36:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668792   8 58451 70573025 A  ERROR'
2018-11-29 19:36:13 [DEBUG   ] Got command BAM from MCS: ref #668791
2018-11-29 19:36:13 [INFO    ] Finished processing BAM request
2018-11-29 19:36:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:36:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668791   8 58451 70573029 A  ERROR'
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:36:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:36:13 [DEBUG   ] spawn_process: at 2018-11-29 19:36:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:36:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 19:36:34 [DEBUG   ] Got command BAM from MCS: ref #668794
2018-11-29 19:36:34 [INFO    ] Finished processing BAM request
2018-11-29 19:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668794   8 58451 70594025 A  ERROR'
2018-11-29 19:36:34 [DEBUG   ] Got command BAM from MCS: ref #668793
2018-11-29 19:36:34 [INFO    ] Finished processing BAM request
2018-11-29 19:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668793   8 58451 70594029 A  ERROR'
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:36:34 [DEBUG   ] spawn_process: at 2018-11-29 19:36:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:36:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:36:55 [DEBUG   ] Got command BAM from MCS: ref #668795
2018-11-29 19:36:55 [INFO    ] Finished processing BAM request
2018-11-29 19:36:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668795   8 58451 70615045 A  ERROR'
2018-11-29 19:36:55 [DEBUG   ] Got command BAM from MCS: ref #668796
2018-11-29 19:36:55 [INFO    ] Finished processing BAM request
2018-11-29 19:36:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668796   8 58451 70615049 A  ERROR'
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:36:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:36:55 [DEBUG   ] spawn_process: at 2018-11-29 19:36:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:36:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:37:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:37:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:37:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:37:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:37:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:37:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:37:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:37:06 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-29 19:37:16 [DEBUG   ] Got command BAM from MCS: ref #668798
2018-11-29 19:37:16 [INFO    ] Finished processing BAM request
2018-11-29 19:37:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668798   8 58451 70636033 A  ERROR'
2018-11-29 19:37:16 [DEBUG   ] Got command BAM from MCS: ref #668797
2018-11-29 19:37:16 [INFO    ] Finished processing BAM request
2018-11-29 19:37:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668797   8 58451 70636037 A  ERROR'
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:37:16 [DEBUG   ] spawn_process: at 2018-11-29 19:37:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:37:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:37:37 [DEBUG   ] Got command BAM from MCS: ref #668799
2018-11-29 19:37:37 [INFO    ] Finished processing BAM request
2018-11-29 19:37:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668799   8 58451 70657029 A  ERROR'
2018-11-29 19:37:37 [DEBUG   ] Got command BAM from MCS: ref #668800
2018-11-29 19:37:37 [INFO    ] Finished processing BAM request
2018-11-29 19:37:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668800   8 58451 70657033 A  ERROR'
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:37:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:37:37 [DEBUG   ] spawn_process: at 2018-11-29 19:37:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:37:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:37:58 [DEBUG   ] Got command BAM from MCS: ref #668802
2018-11-29 19:37:58 [INFO    ] Finished processing BAM request
2018-11-29 19:37:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:37:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668802   8 58451 70678025 A  ERROR'
2018-11-29 19:37:58 [DEBUG   ] Got command BAM from MCS: ref #668801
2018-11-29 19:37:58 [INFO    ] Finished processing BAM request
2018-11-29 19:37:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:37:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668801   8 58451 70678029 A  ERROR'
2018-11-29 19:37:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:37:58 [DEBUG   ] spawn_process: at 2018-11-29 19:37:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 19:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:38:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:38:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:38:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:38:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:38:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:38:06 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-11-29 19:38:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:38:19 [DEBUG   ] Got command BAM from MCS: ref #668808
2018-11-29 19:38:19 [INFO    ] Finished processing BAM request
2018-11-29 19:38:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668808   8 58451 70699025 A  ERROR'
2018-11-29 19:38:19 [DEBUG   ] Got command BAM from MCS: ref #668807
2018-11-29 19:38:19 [INFO    ] Finished processing BAM request
2018-11-29 19:38:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668807   8 58451 70699029 A  ERROR'
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:38:19 [DEBUG   ] spawn_process: at 2018-11-29 19:38:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:38:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:38:40 [DEBUG   ] Got command BAM from MCS: ref #668810
2018-11-29 19:38:40 [INFO    ] Finished processing BAM request
2018-11-29 19:38:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668810   8 58451 70720025 A  ERROR'
2018-11-29 19:38:40 [DEBUG   ] Got command BAM from MCS: ref #668809
2018-11-29 19:38:40 [INFO    ] Finished processing BAM request
2018-11-29 19:38:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668809   8 58451 70720029 A  ERROR'
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:38:40 [DEBUG   ] spawn_process: at 2018-11-29 19:38:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:38:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:39:00 [DEBUG   ] Got command RPT from MCS: ref #668813
2018-11-29 19:39:00 [DEBUG   ] summary = ERROR
2018-11-29 19:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668813  13 58451 70740381 A  ERRORERROR'
2018-11-29 19:39:00 [DEBUG   ] Got command RPT from MCS: ref #668814
2018-11-29 19:39:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668814  77 58451 70740573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:39:00 [DEBUG   ] Got command RPT from MCS: ref #668815
2018-11-29 19:39:00 [DEBUG   ] summary = ERROR
2018-11-29 19:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668815  13 58451 70740777 A  ERRORERROR'
2018-11-29 19:39:00 [DEBUG   ] Got command RPT from MCS: ref #668816
2018-11-29 19:39:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668816  77 58451 70740981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:39:01 [DEBUG   ] Got command BAM from MCS: ref #668811
2018-11-29 19:39:01 [INFO    ] Finished processing BAM request
2018-11-29 19:39:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668811   8 58451 70741033 A  ERROR'
2018-11-29 19:39:01 [DEBUG   ] Got command BAM from MCS: ref #668812
2018-11-29 19:39:01 [INFO    ] Finished processing BAM request
2018-11-29 19:39:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668812   8 58451 70741037 A  ERROR'
2018-11-29 19:39:01 [DEBUG   ] Got command RPT from MCS: ref #668817
2018-11-29 19:39:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668817  12 58451 70741181 A  ERRORB¢ff'
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:39:01 [DEBUG   ] spawn_process: at 2018-11-29 19:39:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 19:39:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:39:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:39:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:39:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:39:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:39:06 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-29 19:39:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:39:22 [DEBUG   ] Got command BAM from MCS: ref #668818
2018-11-29 19:39:22 [INFO    ] Finished processing BAM request
2018-11-29 19:39:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668818   8 58451 70762025 A  ERROR'
2018-11-29 19:39:22 [DEBUG   ] Got command BAM from MCS: ref #668819
2018-11-29 19:39:22 [INFO    ] Finished processing BAM request
2018-11-29 19:39:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668819   8 58451 70762029 A  ERROR'
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:39:22 [DEBUG   ] spawn_process: at 2018-11-29 19:39:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:39:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-29 19:39:43 [DEBUG   ] Got command BAM from MCS: ref #668820
2018-11-29 19:39:43 [INFO    ] Finished processing BAM request
2018-11-29 19:39:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668820   8 58451 70783033 A  ERROR'
2018-11-29 19:39:43 [DEBUG   ] Got command BAM from MCS: ref #668821
2018-11-29 19:39:43 [INFO    ] Finished processing BAM request
2018-11-29 19:39:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668821   8 58451 70783037 A  ERROR'
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:39:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:39:43 [DEBUG   ] spawn_process: at 2018-11-29 19:39:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:39:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:40:04 [DEBUG   ] Got command BAM from MCS: ref #668822
2018-11-29 19:40:04 [INFO    ] Finished processing BAM request
2018-11-29 19:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668822   8 58451 70804033 A  ERROR'
2018-11-29 19:40:04 [DEBUG   ] Got command BAM from MCS: ref #668823
2018-11-29 19:40:04 [INFO    ] Finished processing BAM request
2018-11-29 19:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668823   8 58451 70804037 A  ERROR'
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:40:04 [DEBUG   ] spawn_process: at 2018-11-29 19:40:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 19:40:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:40:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:40:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:40:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:40:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:40:06 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-29 19:40:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 19:40:25 [DEBUG   ] Got command BAM from MCS: ref #668825
2018-11-29 19:40:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668825   8 58451 70825029 A  ERROR'
2018-11-29 19:40:25 [DEBUG   ] Got command BAM from MCS: ref #668824
2018-11-29 19:40:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668824   8 58451 70825033 A  ERROR'
2018-11-29 19:40:25 [INFO    ] Finished processing BAM request
2018-11-29 19:40:25 [INFO    ] Finished processing BAM request
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:40:25 [DEBUG   ] spawn_process: at 2018-11-29 19:40:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:40:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:40:46 [DEBUG   ] Got command BAM from MCS: ref #668826
2018-11-29 19:40:46 [INFO    ] Finished processing BAM request
2018-11-29 19:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668826   8 58451 70846029 A  ERROR'
2018-11-29 19:40:46 [DEBUG   ] Got command BAM from MCS: ref #668827
2018-11-29 19:40:46 [INFO    ] Finished processing BAM request
2018-11-29 19:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668827   8 58451 70846033 A  ERROR'
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:40:46 [DEBUG   ] spawn_process: at 2018-11-29 19:40:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:40:49 [DEBUG   ] Got command RPT from MCS: ref #668828
2018-11-29 19:40:49 [DEBUG   ] summary = ERROR
2018-11-29 19:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668828  13 58451 70849777 A  ERRORERROR'
2018-11-29 19:40:49 [DEBUG   ] Got command RPT from MCS: ref #668829
2018-11-29 19:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668829  77 58451 70849778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:40:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 19:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:41:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:41:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:41:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:41:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:41:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:41:06 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-11-29 19:41:07 [DEBUG   ] Got command BAM from MCS: ref #668846
2018-11-29 19:41:07 [INFO    ] Finished processing BAM request
2018-11-29 19:41:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668846   8 58451 70867033 A  ERROR'
2018-11-29 19:41:07 [DEBUG   ] Got command BAM from MCS: ref #668845
2018-11-29 19:41:07 [INFO    ] Finished processing BAM request
2018-11-29 19:41:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668845   8 58451 70867037 A  ERROR'
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:41:07 [DEBUG   ] spawn_process: at 2018-11-29 19:41:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:41:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 19:41:28 [DEBUG   ] Got command BAM from MCS: ref #668851
2018-11-29 19:41:28 [INFO    ] Finished processing BAM request
2018-11-29 19:41:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668851   8 58451 70888033 A  ERROR'
2018-11-29 19:41:28 [DEBUG   ] Got command BAM from MCS: ref #668852
2018-11-29 19:41:28 [INFO    ] Finished processing BAM request
2018-11-29 19:41:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668852   8 58451 70888037 A  ERROR'
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:41:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:41:28 [DEBUG   ] spawn_process: at 2018-11-29 19:41:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:41:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:41:49 [DEBUG   ] Got command BAM from MCS: ref #668854
2018-11-29 19:41:49 [INFO    ] Finished processing BAM request
2018-11-29 19:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668854   8 58451 70909033 A  ERROR'
2018-11-29 19:41:49 [DEBUG   ] Got command BAM from MCS: ref #668853
2018-11-29 19:41:49 [INFO    ] Finished processing BAM request
2018-11-29 19:41:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668853   8 58451 70909037 A  ERROR'
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:41:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:41:49 [DEBUG   ] spawn_process: at 2018-11-29 19:41:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:41:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:42:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:42:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:42:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:42:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:42:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:42:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:42:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:42:07 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-11-29 19:42:10 [DEBUG   ] Got command BAM from MCS: ref #668856
2018-11-29 19:42:10 [INFO    ] Finished processing BAM request
2018-11-29 19:42:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668856   8 58451 70930025 A  ERROR'
2018-11-29 19:42:10 [DEBUG   ] Got command BAM from MCS: ref #668855
2018-11-29 19:42:10 [INFO    ] Finished processing BAM request
2018-11-29 19:42:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668855   8 58451 70930029 A  ERROR'
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:42:10 [DEBUG   ] spawn_process: at 2018-11-29 19:42:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:42:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:42:31 [DEBUG   ] Got command BAM from MCS: ref #668857
2018-11-29 19:42:31 [INFO    ] Finished processing BAM request
2018-11-29 19:42:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668857   8 58451 70951041 A  ERROR'
2018-11-29 19:42:31 [DEBUG   ] Got command BAM from MCS: ref #668858
2018-11-29 19:42:31 [INFO    ] Finished processing BAM request
2018-11-29 19:42:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668858   8 58451 70951045 A  ERROR'
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:42:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:42:31 [DEBUG   ] spawn_process: at 2018-11-29 19:42:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:42:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:42:52 [DEBUG   ] Got command BAM from MCS: ref #668860
2018-11-29 19:42:52 [INFO    ] Finished processing BAM request
2018-11-29 19:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668860   8 58451 70972025 A  ERROR'
2018-11-29 19:42:52 [DEBUG   ] Got command BAM from MCS: ref #668859
2018-11-29 19:42:52 [INFO    ] Finished processing BAM request
2018-11-29 19:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668859   8 58451 70972029 A  ERROR'
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:42:52 [DEBUG   ] spawn_process: at 2018-11-29 19:42:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:42:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:43:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:43:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:43:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:43:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:43:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:43:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:43:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:43:07 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-29 19:43:13 [DEBUG   ] Got command BAM from MCS: ref #668861
2018-11-29 19:43:13 [INFO    ] Finished processing BAM request
2018-11-29 19:43:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668861   8 58451 70993029 A  ERROR'
2018-11-29 19:43:13 [DEBUG   ] Got command BAM from MCS: ref #668862
2018-11-29 19:43:13 [INFO    ] Finished processing BAM request
2018-11-29 19:43:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668862   8 58451 70993033 A  ERROR'
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:43:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:43:13 [DEBUG   ] spawn_process: at 2018-11-29 19:43:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:43:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:43:34 [DEBUG   ] Got command BAM from MCS: ref #668863
2018-11-29 19:43:34 [INFO    ] Finished processing BAM request
2018-11-29 19:43:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668863   8 58451 71014025 A  ERROR'
2018-11-29 19:43:34 [DEBUG   ] Got command BAM from MCS: ref #668864
2018-11-29 19:43:34 [INFO    ] Finished processing BAM request
2018-11-29 19:43:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668864   8 58451 71014029 A  ERROR'
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:43:34 [DEBUG   ] spawn_process: at 2018-11-29 19:43:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:43:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:43:55 [DEBUG   ] Got command BAM from MCS: ref #668867
2018-11-29 19:43:55 [INFO    ] Finished processing BAM request
2018-11-29 19:43:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668867   8 58451 71035057 A  ERROR'
2018-11-29 19:43:55 [DEBUG   ] Got command BAM from MCS: ref #668868
2018-11-29 19:43:55 [INFO    ] Finished processing BAM request
2018-11-29 19:43:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668868   8 58451 71035065 A  ERROR'
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:43:55 [DEBUG   ] spawn_process: at 2018-11-29 19:43:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:43:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:44:00 [DEBUG   ] Got command RPT from MCS: ref #668869
2018-11-29 19:44:00 [DEBUG   ] summary = ERROR
2018-11-29 19:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668869  13 58451 71040465 A  ERRORERROR'
2018-11-29 19:44:00 [DEBUG   ] Got command RPT from MCS: ref #668870
2018-11-29 19:44:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668870  77 58451 71040657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:44:00 [DEBUG   ] Got command RPT from MCS: ref #668871
2018-11-29 19:44:00 [DEBUG   ] summary = ERROR
2018-11-29 19:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668871  13 58451 71040861 A  ERRORERROR'
2018-11-29 19:44:01 [DEBUG   ] Got command RPT from MCS: ref #668873
2018-11-29 19:44:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668873  77 58451 71041065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:44:01 [DEBUG   ] Got command RPT from MCS: ref #668874
2018-11-29 19:44:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668874  12 58451 71041269 A  ERRORB¢ff'
2018-11-29 19:44:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:44:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:44:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:44:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:44:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:44:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:44:06 [DEBUG   ] Finished updating board flags in 1.058 seconds
2018-11-29 19:44:16 [DEBUG   ] Got command BAM from MCS: ref #668883
2018-11-29 19:44:16 [INFO    ] Finished processing BAM request
2018-11-29 19:44:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668883   8 58451 71056025 A  ERROR'
2018-11-29 19:44:16 [DEBUG   ] Got command BAM from MCS: ref #668884
2018-11-29 19:44:16 [INFO    ] Finished processing BAM request
2018-11-29 19:44:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668884   8 58451 71056029 A  ERROR'
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:44:16 [DEBUG   ] spawn_process: at 2018-11-29 19:44:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:44:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:44:37 [DEBUG   ] Got command BAM from MCS: ref #668885
2018-11-29 19:44:37 [INFO    ] Finished processing BAM request
2018-11-29 19:44:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668885   8 58451 71077029 A  ERROR'
2018-11-29 19:44:37 [DEBUG   ] Got command BAM from MCS: ref #668886
2018-11-29 19:44:37 [INFO    ] Finished processing BAM request
2018-11-29 19:44:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668886   8 58451 71077033 A  ERROR'
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:44:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:44:37 [DEBUG   ] spawn_process: at 2018-11-29 19:44:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:44:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:44:58 [DEBUG   ] Got command BAM from MCS: ref #668887
2018-11-29 19:44:58 [INFO    ] Finished processing BAM request
2018-11-29 19:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668887   8 58451 71098025 A  ERROR'
2018-11-29 19:44:58 [DEBUG   ] Got command BAM from MCS: ref #668888
2018-11-29 19:44:58 [INFO    ] Finished processing BAM request
2018-11-29 19:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668888   8 58451 71098029 A  ERROR'
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:44:58 [DEBUG   ] spawn_process: at 2018-11-29 19:44:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:44:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 19:45:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:45:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:45:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:45:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:45:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:45:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:45:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:45:06 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-29 19:45:19 [DEBUG   ] Got command BAM from MCS: ref #668889
2018-11-29 19:45:19 [INFO    ] Finished processing BAM request
2018-11-29 19:45:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668889   8 58451 71119029 A  ERROR'
2018-11-29 19:45:19 [DEBUG   ] Got command BAM from MCS: ref #668890
2018-11-29 19:45:19 [INFO    ] Finished processing BAM request
2018-11-29 19:45:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668890   8 58451 71119033 A  ERROR'
2018-11-29 19:45:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:45:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:45:19 [DEBUG   ] spawn_process: at 2018-11-29 19:45:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:45:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:45:40 [DEBUG   ] Got command BAM from MCS: ref #668891
2018-11-29 19:45:40 [INFO    ] Finished processing BAM request
2018-11-29 19:45:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668891   8 58451 71140025 A  ERROR'
2018-11-29 19:45:40 [DEBUG   ] Got command BAM from MCS: ref #668892
2018-11-29 19:45:40 [INFO    ] Finished processing BAM request
2018-11-29 19:45:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668892   8 58451 71140029 A  ERROR'
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:45:40 [DEBUG   ] spawn_process: at 2018-11-29 19:45:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:45:49 [DEBUG   ] Got command RPT from MCS: ref #668893
2018-11-29 19:45:49 [DEBUG   ] summary = ERROR
2018-11-29 19:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668893  13 58451 71149785 A  ERRORERROR'
2018-11-29 19:45:49 [DEBUG   ] Got command RPT from MCS: ref #668894
2018-11-29 19:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668894  77 58451 71149786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:45:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:46:01 [DEBUG   ] Got command BAM from MCS: ref #668911
2018-11-29 19:46:01 [INFO    ] Finished processing BAM request
2018-11-29 19:46:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668911   8 58451 71161029 A  ERROR'
2018-11-29 19:46:01 [DEBUG   ] Got command BAM from MCS: ref #668910
2018-11-29 19:46:01 [INFO    ] Finished processing BAM request
2018-11-29 19:46:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668910   8 58451 71161033 A  ERROR'
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:46:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:46:01 [DEBUG   ] spawn_process: at 2018-11-29 19:46:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 19:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:46:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:46:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:46:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:46:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:46:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:46:06 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-29 19:46:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:46:22 [DEBUG   ] Got command BAM from MCS: ref #668913
2018-11-29 19:46:22 [INFO    ] Finished processing BAM request
2018-11-29 19:46:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668913   8 58451 71182025 A  ERROR'
2018-11-29 19:46:22 [DEBUG   ] Got command BAM from MCS: ref #668912
2018-11-29 19:46:22 [INFO    ] Finished processing BAM request
2018-11-29 19:46:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668912   8 58451 71182029 A  ERROR'
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:46:22 [DEBUG   ] spawn_process: at 2018-11-29 19:46:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:46:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:46:43 [DEBUG   ] Got command BAM from MCS: ref #668915
2018-11-29 19:46:43 [INFO    ] Finished processing BAM request
2018-11-29 19:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668915   8 58451 71203029 A  ERROR'
2018-11-29 19:46:43 [DEBUG   ] Got command BAM from MCS: ref #668914
2018-11-29 19:46:43 [INFO    ] Finished processing BAM request
2018-11-29 19:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668914   8 58451 71203033 A  ERROR'
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:46:43 [DEBUG   ] spawn_process: at 2018-11-29 19:46:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:46:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:47:04 [DEBUG   ] Got command BAM from MCS: ref #668916
2018-11-29 19:47:04 [INFO    ] Finished processing BAM request
2018-11-29 19:47:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:47:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668916   8 58451 71224029 A  ERROR'
2018-11-29 19:47:04 [DEBUG   ] Got command BAM from MCS: ref #668917
2018-11-29 19:47:04 [INFO    ] Finished processing BAM request
2018-11-29 19:47:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:47:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668917   8 58451 71224033 A  ERROR'
2018-11-29 19:47:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:47:04 [DEBUG   ] spawn_process: at 2018-11-29 19:47:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:47:05 [DEBUG   ] spawn_process: at 2018-11-29 19:47:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 19:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:47:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:47:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:47:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:47:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:47:06 [WARNING ] (13, 1, 'bot')
2018-11-29 19:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:47:06 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-29 19:47:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:47:25 [DEBUG   ] Got command BAM from MCS: ref #668923
2018-11-29 19:47:25 [INFO    ] Finished processing BAM request
2018-11-29 19:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668923   8 58451 71245029 A  ERROR'
2018-11-29 19:47:25 [DEBUG   ] Got command BAM from MCS: ref #668922
2018-11-29 19:47:25 [INFO    ] Finished processing BAM request
2018-11-29 19:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668922   8 58451 71245033 A  ERROR'
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:47:25 [DEBUG   ] spawn_process: at 2018-11-29 19:47:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:47:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:47:46 [DEBUG   ] Got command BAM from MCS: ref #668925
2018-11-29 19:47:46 [INFO    ] Finished processing BAM request
2018-11-29 19:47:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:47:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668925   8 58451 71266025 A  ERROR'
2018-11-29 19:47:46 [DEBUG   ] Got command BAM from MCS: ref #668924
2018-11-29 19:47:46 [INFO    ] Finished processing BAM request
2018-11-29 19:47:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:47:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668924   8 58451 71266029 A  ERROR'
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:47:46 [DEBUG   ] spawn_process: at 2018-11-29 19:47:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:47:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:48:07 [DEBUG   ] Got command BAM from MCS: ref #668927
2018-11-29 19:48:07 [INFO    ] Finished processing BAM request
2018-11-29 19:48:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668927   8 58451 71287033 A  ERROR'
2018-11-29 19:48:07 [DEBUG   ] Got command BAM from MCS: ref #668926
2018-11-29 19:48:07 [INFO    ] Finished processing BAM request
2018-11-29 19:48:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668926   8 58451 71287037 A  ERROR'
2018-11-29 19:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:48:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:48:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:48:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:48:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:48:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:48:07 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:48:07 [DEBUG   ] spawn_process: at 2018-11-29 19:48:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:48:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:48:28 [DEBUG   ] Got command BAM from MCS: ref #668929
2018-11-29 19:48:28 [INFO    ] Finished processing BAM request
2018-11-29 19:48:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668929   8 58451 71308033 A  ERROR'
2018-11-29 19:48:28 [DEBUG   ] Got command BAM from MCS: ref #668928
2018-11-29 19:48:28 [INFO    ] Finished processing BAM request
2018-11-29 19:48:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668928   8 58451 71308037 A  ERROR'
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:48:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:48:28 [DEBUG   ] spawn_process: at 2018-11-29 19:48:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:48:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:48:49 [DEBUG   ] Got command BAM from MCS: ref #668931
2018-11-29 19:48:49 [INFO    ] Finished processing BAM request
2018-11-29 19:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668931   8 58451 71329029 A  ERROR'
2018-11-29 19:48:49 [DEBUG   ] Got command BAM from MCS: ref #668930
2018-11-29 19:48:49 [INFO    ] Finished processing BAM request
2018-11-29 19:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668930   8 58451 71329033 A  ERROR'
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:48:49 [DEBUG   ] spawn_process: at 2018-11-29 19:48:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:48:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:49:00 [DEBUG   ] Got command RPT from MCS: ref #668932
2018-11-29 19:49:00 [DEBUG   ] summary = ERROR
2018-11-29 19:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668932  13 58451 71340545 A  ERRORERROR'
2018-11-29 19:49:00 [DEBUG   ] Got command RPT from MCS: ref #668933
2018-11-29 19:49:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668933  77 58451 71340749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:49:00 [DEBUG   ] Got command RPT from MCS: ref #668934
2018-11-29 19:49:00 [DEBUG   ] summary = ERROR
2018-11-29 19:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668934  13 58451 71340953 A  ERRORERROR'
2018-11-29 19:49:01 [DEBUG   ] Got command RPT from MCS: ref #668935
2018-11-29 19:49:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668935  77 58451 71341145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:49:01 [DEBUG   ] Got command RPT from MCS: ref #668936
2018-11-29 19:49:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668936  12 58451 71341349 A  ERRORB¡ff'
2018-11-29 19:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 19:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 19:49:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:49:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:49:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:49:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:49:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:49:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:49:07 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-11-29 19:49:10 [DEBUG   ] Got command BAM from MCS: ref #668937
2018-11-29 19:49:10 [INFO    ] Finished processing BAM request
2018-11-29 19:49:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668937   8 58451 71350029 A  ERROR'
2018-11-29 19:49:10 [DEBUG   ] Got command BAM from MCS: ref #668938
2018-11-29 19:49:10 [INFO    ] Finished processing BAM request
2018-11-29 19:49:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668938   8 58451 71350033 A  ERROR'
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:49:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:49:10 [DEBUG   ] spawn_process: at 2018-11-29 19:49:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:49:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 19:49:31 [DEBUG   ] Got command BAM from MCS: ref #668940
2018-11-29 19:49:31 [INFO    ] Finished processing BAM request
2018-11-29 19:49:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668940   8 58451 71371033 A  ERROR'
2018-11-29 19:49:31 [DEBUG   ] Got command BAM from MCS: ref #668939
2018-11-29 19:49:31 [INFO    ] Finished processing BAM request
2018-11-29 19:49:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668939   8 58451 71371037 A  ERROR'
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:49:31 [DEBUG   ] spawn_process: at 2018-11-29 19:49:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:49:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 19:49:52 [DEBUG   ] Got command BAM from MCS: ref #668941
2018-11-29 19:49:52 [INFO    ] Finished processing BAM request
2018-11-29 19:49:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668941   8 58451 71392033 A  ERROR'
2018-11-29 19:49:52 [DEBUG   ] Got command BAM from MCS: ref #668942
2018-11-29 19:49:52 [INFO    ] Finished processing BAM request
2018-11-29 19:49:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668942   8 58451 71392037 A  ERROR'
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:49:52 [DEBUG   ] spawn_process: at 2018-11-29 19:49:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:49:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 19:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 19:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:50:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:50:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:50:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:50:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:50:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:50:07 [DEBUG   ] Finished updating board flags in 1.210 seconds
2018-11-29 19:50:13 [DEBUG   ] Got command BAM from MCS: ref #668943
2018-11-29 19:50:13 [INFO    ] Finished processing BAM request
2018-11-29 19:50:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668943   8 58451 71413025 A  ERROR'
2018-11-29 19:50:13 [DEBUG   ] Got command BAM from MCS: ref #668944
2018-11-29 19:50:13 [INFO    ] Finished processing BAM request
2018-11-29 19:50:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668944   8 58451 71413029 A  ERROR'
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:50:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:50:13 [DEBUG   ] spawn_process: at 2018-11-29 19:50:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:50:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:50:34 [DEBUG   ] Got command BAM from MCS: ref #668950
2018-11-29 19:50:34 [INFO    ] Finished processing BAM request
2018-11-29 19:50:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668950   8 58451 71434033 A  ERROR'
2018-11-29 19:50:34 [DEBUG   ] Got command BAM from MCS: ref #668949
2018-11-29 19:50:34 [INFO    ] Finished processing BAM request
2018-11-29 19:50:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:50:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668949   8 58451 71434037 A  ERROR'
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:50:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:50:34 [DEBUG   ] spawn_process: at 2018-11-29 19:50:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:50:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:50:49 [DEBUG   ] Got command RPT from MCS: ref #668951
2018-11-29 19:50:49 [DEBUG   ] summary = ERROR
2018-11-29 19:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668951  13 58451 71449781 A  ERRORERROR'
2018-11-29 19:50:49 [DEBUG   ] Got command RPT from MCS: ref #668952
2018-11-29 19:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668952  77 58451 71449782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:50:56 [DEBUG   ] Got command BAM from MCS: ref #668968
2018-11-29 19:50:56 [INFO    ] Finished processing BAM request
2018-11-29 19:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668968   8 58451 71456025 A  ERROR'
2018-11-29 19:50:56 [DEBUG   ] Got command BAM from MCS: ref #668969
2018-11-29 19:50:56 [INFO    ] Finished processing BAM request
2018-11-29 19:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668969   8 58451 71456029 A  ERROR'
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:50:56 [DEBUG   ] spawn_process: at 2018-11-29 19:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:50:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:51:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:51:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:51:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:51:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:51:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:51:07 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-29 19:51:18 [DEBUG   ] Got command BAM from MCS: ref #668971
2018-11-29 19:51:18 [INFO    ] Finished processing BAM request
2018-11-29 19:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668971   8 58451 71478029 A  ERROR'
2018-11-29 19:51:18 [DEBUG   ] Got command BAM from MCS: ref #668970
2018-11-29 19:51:18 [INFO    ] Finished processing BAM request
2018-11-29 19:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668970   8 58451 71478033 A  ERROR'
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:51:18 [DEBUG   ] spawn_process: at 2018-11-29 19:51:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:51:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:51:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:51:40 [DEBUG   ] Got command BAM from MCS: ref #668972
2018-11-29 19:51:40 [INFO    ] Finished processing BAM request
2018-11-29 19:51:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668972   8 58451 71500029 A  ERROR'
2018-11-29 19:51:40 [DEBUG   ] Got command BAM from MCS: ref #668973
2018-11-29 19:51:40 [INFO    ] Finished processing BAM request
2018-11-29 19:51:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668973   8 58451 71500033 A  ERROR'
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:51:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:51:40 [DEBUG   ] spawn_process: at 2018-11-29 19:51:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:51:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:52:02 [DEBUG   ] Got command BAM from MCS: ref #668974
2018-11-29 19:52:02 [INFO    ] Finished processing BAM request
2018-11-29 19:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668974   8 58451 71522033 A  ERROR'
2018-11-29 19:52:02 [DEBUG   ] Got command BAM from MCS: ref #668975
2018-11-29 19:52:02 [INFO    ] Finished processing BAM request
2018-11-29 19:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668975   8 58451 71522037 A  ERROR'
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:52:02 [DEBUG   ] spawn_process: at 2018-11-29 19:52:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 19:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:52:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:52:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:52:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:52:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:52:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:52:07 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-11-29 19:52:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:52:24 [DEBUG   ] Got command BAM from MCS: ref #668977
2018-11-29 19:52:24 [INFO    ] Finished processing BAM request
2018-11-29 19:52:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668977   8 58451 71544029 A  ERROR'
2018-11-29 19:52:24 [DEBUG   ] Got command BAM from MCS: ref #668976
2018-11-29 19:52:24 [INFO    ] Finished processing BAM request
2018-11-29 19:52:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668976   8 58451 71544033 A  ERROR'
2018-11-29 19:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:52:24 [DEBUG   ] spawn_process: at 2018-11-29 19:52:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:52:25 [DEBUG   ] spawn_process: at 2018-11-29 19:52:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:52:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:52:46 [DEBUG   ] Got command BAM from MCS: ref #668979
2018-11-29 19:52:46 [INFO    ] Finished processing BAM request
2018-11-29 19:52:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:52:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668979   8 58451 71566033 A  ERROR'
2018-11-29 19:52:46 [DEBUG   ] Got command BAM from MCS: ref #668978
2018-11-29 19:52:46 [INFO    ] Finished processing BAM request
2018-11-29 19:52:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:52:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668978   8 58451 71566037 A  ERROR'
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:52:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:52:46 [DEBUG   ] spawn_process: at 2018-11-29 19:52:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:52:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 19:53:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:53:08 [DEBUG   ] Got command BAM from MCS: ref #668981
2018-11-29 19:53:08 [INFO    ] Finished processing BAM request
2018-11-29 19:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668981   8 58451 71588026 A  ERROR'
2018-11-29 19:53:08 [DEBUG   ] Got command BAM from MCS: ref #668980
2018-11-29 19:53:08 [INFO    ] Finished processing BAM request
2018-11-29 19:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668980   8 58451 71588033 A  ERROR'
2018-11-29 19:53:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:53:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:53:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:53:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:53:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:53:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:53:08 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:53:08 [DEBUG   ] spawn_process: at 2018-11-29 19:53:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:53:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:53:30 [DEBUG   ] Got command BAM from MCS: ref #668986
2018-11-29 19:53:30 [INFO    ] Finished processing BAM request
2018-11-29 19:53:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668986   8 58451 71610025 A  ERROR'
2018-11-29 19:53:30 [DEBUG   ] Got command BAM from MCS: ref #668987
2018-11-29 19:53:30 [INFO    ] Finished processing BAM request
2018-11-29 19:53:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668987   8 58451 71610029 A  ERROR'
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:53:30 [DEBUG   ] spawn_process: at 2018-11-29 19:53:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:53:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:53:52 [DEBUG   ] Got command BAM from MCS: ref #668991
2018-11-29 19:53:52 [INFO    ] Finished processing BAM request
2018-11-29 19:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668991   8 58451 71632029 A  ERROR'
2018-11-29 19:53:52 [DEBUG   ] Got command BAM from MCS: ref #668990
2018-11-29 19:53:52 [INFO    ] Finished processing BAM request
2018-11-29 19:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   668990   8 58451 71632033 A  ERROR'
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:53:52 [DEBUG   ] spawn_process: at 2018-11-29 19:53:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:53:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:54:00 [DEBUG   ] Got command RPT from MCS: ref #668992
2018-11-29 19:54:00 [DEBUG   ] summary = ERROR
2018-11-29 19:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668992  13 58451 71640633 A  ERRORERROR'
2018-11-29 19:54:00 [DEBUG   ] Got command RPT from MCS: ref #668993
2018-11-29 19:54:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668993  77 58451 71640837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:54:01 [DEBUG   ] Got command RPT from MCS: ref #668994
2018-11-29 19:54:01 [DEBUG   ] summary = ERROR
2018-11-29 19:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668994  13 58451 71641029 A  ERRORERROR'
2018-11-29 19:54:01 [DEBUG   ] Got command RPT from MCS: ref #668996
2018-11-29 19:54:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668996  77 58451 71641233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:54:01 [DEBUG   ] Got command RPT from MCS: ref #668998
2018-11-29 19:54:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   668998  12 58451 71641437 A  ERRORB¢ff'
2018-11-29 19:54:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:54:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:54:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:54:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:54:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:54:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:54:07 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-11-29 19:54:14 [DEBUG   ] Got command BAM from MCS: ref #669002
2018-11-29 19:54:14 [INFO    ] Finished processing BAM request
2018-11-29 19:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669002   8 58451 71654033 A  ERROR'
2018-11-29 19:54:14 [DEBUG   ] Got command BAM from MCS: ref #669003
2018-11-29 19:54:14 [INFO    ] Finished processing BAM request
2018-11-29 19:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669003   8 58451 71654037 A  ERROR'
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:54:14 [DEBUG   ] spawn_process: at 2018-11-29 19:54:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:54:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:54:36 [DEBUG   ] Got command BAM from MCS: ref #669004
2018-11-29 19:54:36 [INFO    ] Finished processing BAM request
2018-11-29 19:54:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669004   8 58451 71676025 A  ERROR'
2018-11-29 19:54:36 [DEBUG   ] Got command BAM from MCS: ref #669005
2018-11-29 19:54:36 [INFO    ] Finished processing BAM request
2018-11-29 19:54:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669005   8 58451 71676029 A  ERROR'
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:54:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:54:36 [DEBUG   ] spawn_process: at 2018-11-29 19:54:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:54:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:54:58 [DEBUG   ] Got command BAM from MCS: ref #669007
2018-11-29 19:54:58 [INFO    ] Finished processing BAM request
2018-11-29 19:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669007   8 58451 71698025 A  ERROR'
2018-11-29 19:54:58 [DEBUG   ] Got command BAM from MCS: ref #669006
2018-11-29 19:54:58 [INFO    ] Finished processing BAM request
2018-11-29 19:54:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669006   8 58451 71698029 A  ERROR'
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:54:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:54:58 [DEBUG   ] spawn_process: at 2018-11-29 19:54:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:54:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 19:55:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 19:55:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:55:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:55:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:55:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:55:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:55:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:55:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:55:08 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-11-29 19:55:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 19:55:20 [DEBUG   ] Got command BAM from MCS: ref #669009
2018-11-29 19:55:20 [INFO    ] Finished processing BAM request
2018-11-29 19:55:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669009   8 58451 71720025 A  ERROR'
2018-11-29 19:55:20 [DEBUG   ] Got command BAM from MCS: ref #669008
2018-11-29 19:55:20 [INFO    ] Finished processing BAM request
2018-11-29 19:55:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669008   8 58451 71720029 A  ERROR'
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:55:20 [DEBUG   ] spawn_process: at 2018-11-29 19:55:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:55:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:55:42 [DEBUG   ] Got command BAM from MCS: ref #669011
2018-11-29 19:55:42 [INFO    ] Finished processing BAM request
2018-11-29 19:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669011   8 58451 71742033 A  ERROR'
2018-11-29 19:55:42 [DEBUG   ] Got command BAM from MCS: ref #669010
2018-11-29 19:55:42 [INFO    ] Finished processing BAM request
2018-11-29 19:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669010   8 58451 71742037 A  ERROR'
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:55:42 [DEBUG   ] spawn_process: at 2018-11-29 19:55:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:55:49 [DEBUG   ] Got command RPT from MCS: ref #669012
2018-11-29 19:55:49 [DEBUG   ] summary = ERROR
2018-11-29 19:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669012  13 58451 71749789 A  ERRORERROR'
2018-11-29 19:55:49 [DEBUG   ] Got command RPT from MCS: ref #669013
2018-11-29 19:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669013  77 58451 71749790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:55:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 19:56:04 [DEBUG   ] Got command BAM from MCS: ref #669029
2018-11-29 19:56:04 [INFO    ] Finished processing BAM request
2018-11-29 19:56:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669029   8 58451 71764025 A  ERROR'
2018-11-29 19:56:04 [DEBUG   ] Got command BAM from MCS: ref #669030
2018-11-29 19:56:04 [INFO    ] Finished processing BAM request
2018-11-29 19:56:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669030   8 58451 71764029 A  ERROR'
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:56:04 [DEBUG   ] spawn_process: at 2018-11-29 19:56:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:56:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 19:56:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 19:56:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:56:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:56:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:56:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:56:07 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-29 19:56:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 19:56:26 [DEBUG   ] Got command BAM from MCS: ref #669035
2018-11-29 19:56:26 [INFO    ] Finished processing BAM request
2018-11-29 19:56:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669035   8 58451 71786033 A  ERROR'
2018-11-29 19:56:26 [DEBUG   ] Got command BAM from MCS: ref #669036
2018-11-29 19:56:26 [INFO    ] Finished processing BAM request
2018-11-29 19:56:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669036   8 58451 71786037 A  ERROR'
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:56:26 [DEBUG   ] spawn_process: at 2018-11-29 19:56:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:56:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:56:48 [DEBUG   ] Got command BAM from MCS: ref #669038
2018-11-29 19:56:48 [INFO    ] Finished processing BAM request
2018-11-29 19:56:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669038   8 58451 71808029 A  ERROR'
2018-11-29 19:56:48 [DEBUG   ] Got command BAM from MCS: ref #669037
2018-11-29 19:56:48 [INFO    ] Finished processing BAM request
2018-11-29 19:56:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669037   8 58451 71808033 A  ERROR'
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:56:48 [DEBUG   ] spawn_process: at 2018-11-29 19:56:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:57:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:57:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:57:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 19:57:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:57:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:57:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:57:07 [WARNING ] (13, 1, 'bot')
2018-11-29 19:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:57:07 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-29 19:57:10 [DEBUG   ] Got command BAM from MCS: ref #669040
2018-11-29 19:57:10 [INFO    ] Finished processing BAM request
2018-11-29 19:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669040   8 58451 71830029 A  ERROR'
2018-11-29 19:57:10 [DEBUG   ] Got command BAM from MCS: ref #669039
2018-11-29 19:57:10 [INFO    ] Finished processing BAM request
2018-11-29 19:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669039   8 58451 71830033 A  ERROR'
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:57:10 [DEBUG   ] spawn_process: at 2018-11-29 19:57:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:57:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:57:32 [DEBUG   ] Got command BAM from MCS: ref #669041
2018-11-29 19:57:32 [INFO    ] Finished processing BAM request
2018-11-29 19:57:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669041   8 58451 71852029 A  ERROR'
2018-11-29 19:57:32 [DEBUG   ] Got command BAM from MCS: ref #669042
2018-11-29 19:57:32 [INFO    ] Finished processing BAM request
2018-11-29 19:57:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669042   8 58451 71852033 A  ERROR'
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:57:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:57:32 [DEBUG   ] spawn_process: at 2018-11-29 19:57:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:57:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:57:54 [DEBUG   ] Got command BAM from MCS: ref #669043
2018-11-29 19:57:54 [INFO    ] Finished processing BAM request
2018-11-29 19:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669043   8 58451 71874033 A  ERROR'
2018-11-29 19:57:54 [DEBUG   ] Got command BAM from MCS: ref #669044
2018-11-29 19:57:54 [INFO    ] Finished processing BAM request
2018-11-29 19:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669044   8 58451 71874037 A  ERROR'
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 19:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 19:57:54 [DEBUG   ] spawn_process: at 2018-11-29 19:57:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 19:58:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:58:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:58:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:58:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:58:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:58:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:58:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:58:08 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-11-29 19:58:16 [DEBUG   ] Got command BAM from MCS: ref #669046
2018-11-29 19:58:16 [INFO    ] Finished processing BAM request
2018-11-29 19:58:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669046   8 58451 71896025 A  ERROR'
2018-11-29 19:58:16 [DEBUG   ] Got command BAM from MCS: ref #669045
2018-11-29 19:58:16 [INFO    ] Finished processing BAM request
2018-11-29 19:58:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669045   8 58451 71896029 A  ERROR'
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:58:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:58:16 [DEBUG   ] spawn_process: at 2018-11-29 19:58:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 19:58:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:58:38 [DEBUG   ] Got command BAM from MCS: ref #669048
2018-11-29 19:58:38 [INFO    ] Finished processing BAM request
2018-11-29 19:58:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669048   8 58451 71918029 A  ERROR'
2018-11-29 19:58:38 [DEBUG   ] Got command BAM from MCS: ref #669047
2018-11-29 19:58:38 [INFO    ] Finished processing BAM request
2018-11-29 19:58:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669047   8 58451 71918033 A  ERROR'
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 19:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 19:58:38 [DEBUG   ] spawn_process: at 2018-11-29 19:58:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 19:58:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:59:00 [DEBUG   ] Got command BAM from MCS: ref #669050
2018-11-29 19:59:00 [INFO    ] Finished processing BAM request
2018-11-29 19:59:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669050   8 58451 71940033 A  ERROR'
2018-11-29 19:59:00 [DEBUG   ] Got command BAM from MCS: ref #669049
2018-11-29 19:59:00 [INFO    ] Finished processing BAM request
2018-11-29 19:59:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669049   8 58451 71940037 A  ERROR'
2018-11-29 19:59:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:59:00 [DEBUG   ] Got command RPT from MCS: ref #669051
2018-11-29 19:59:00 [DEBUG   ] summary = ERROR
2018-11-29 19:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669051  13 58451 71940721 A  ERRORERROR'
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 19:59:00 [DEBUG   ] Got command RPT from MCS: ref #669052
2018-11-29 19:59:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669052  77 58451 71940926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 19:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 19:59:00 [DEBUG   ] spawn_process: at 2018-11-29 19:59:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 19:59:01 [DEBUG   ] Got command RPT from MCS: ref #669053
2018-11-29 19:59:01 [DEBUG   ] summary = ERROR
2018-11-29 19:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669053  13 58451 71941117 A  ERRORERROR'
2018-11-29 19:59:01 [DEBUG   ] Got command RPT from MCS: ref #669054
2018-11-29 19:59:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 19:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669054  77 58451 71941325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 19:59:01 [DEBUG   ] Got command RPT from MCS: ref #669055
2018-11-29 19:59:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 19:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669055  12 58451 71941525 A  ERRORB£ff'
2018-11-29 19:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 19:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 19:59:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 19:59:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 19:59:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 19:59:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:59:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:59:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:59:08 [WARNING ] (13, 1, 'bot')
2018-11-29 19:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 19:59:08 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-29 19:59:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:59:22 [DEBUG   ] Got command BAM from MCS: ref #669061
2018-11-29 19:59:22 [INFO    ] Finished processing BAM request
2018-11-29 19:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669061   8 58451 71962025 A  ERROR'
2018-11-29 19:59:22 [DEBUG   ] Got command BAM from MCS: ref #669060
2018-11-29 19:59:22 [INFO    ] Finished processing BAM request
2018-11-29 19:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669060   8 58451 71962029 A  ERROR'
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 19:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 19:59:22 [DEBUG   ] spawn_process: at 2018-11-29 19:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 19:59:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 19:59:44 [DEBUG   ] Got command BAM from MCS: ref #669063
2018-11-29 19:59:44 [INFO    ] Finished processing BAM request
2018-11-29 19:59:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669063   8 58451 71984033 A  ERROR'
2018-11-29 19:59:44 [DEBUG   ] Got command BAM from MCS: ref #669062
2018-11-29 19:59:44 [INFO    ] Finished processing BAM request
2018-11-29 19:59:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 19:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669062   8 58451 71984037 A  ERROR'
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 19:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 19:59:44 [DEBUG   ] spawn_process: at 2018-11-29 19:59:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:00:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:00:06 [DEBUG   ] Got command BAM from MCS: ref #669065
2018-11-29 20:00:06 [INFO    ] Finished processing BAM request
2018-11-29 20:00:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669065   8 58451 72006025 A  ERROR'
2018-11-29 20:00:06 [DEBUG   ] Got command BAM from MCS: ref #669064
2018-11-29 20:00:06 [INFO    ] Finished processing BAM request
2018-11-29 20:00:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669064   8 58451 72006029 A  ERROR'
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:00:06 [DEBUG   ] spawn_process: at 2018-11-29 20:00:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:00:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:00:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:00:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:00:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:00:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:00:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:00:08 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-11-29 20:00:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:00:29 [DEBUG   ] Got command BAM from MCS: ref #669066
2018-11-29 20:00:29 [INFO    ] Finished processing BAM request
2018-11-29 20:00:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669066   8 58451 72029029 A  ERROR'
2018-11-29 20:00:29 [DEBUG   ] Got command BAM from MCS: ref #669067
2018-11-29 20:00:29 [INFO    ] Finished processing BAM request
2018-11-29 20:00:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669067   8 58451 72029033 A  ERROR'
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:00:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:00:29 [DEBUG   ] spawn_process: at 2018-11-29 20:00:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:00:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:00:49 [DEBUG   ] Got command RPT from MCS: ref #669068
2018-11-29 20:00:49 [DEBUG   ] summary = ERROR
2018-11-29 20:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669068  13 58451 72049781 A  ERRORERROR'
2018-11-29 20:00:49 [DEBUG   ] Got command RPT from MCS: ref #669069
2018-11-29 20:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669069  77 58451 72049782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:00:52 [DEBUG   ] Got command BAM from MCS: ref #669086
2018-11-29 20:00:52 [INFO    ] Finished processing BAM request
2018-11-29 20:00:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:00:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669086   8 58451 72052029 A  ERROR'
2018-11-29 20:00:52 [DEBUG   ] Got command BAM from MCS: ref #669085
2018-11-29 20:00:52 [INFO    ] Finished processing BAM request
2018-11-29 20:00:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:00:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669085   8 58451 72052033 A  ERROR'
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:00:52 [DEBUG   ] spawn_process: at 2018-11-29 20:00:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:01:00 [DEBUG   ] Finished updating ant stats in 1.090 seconds
2018-11-29 20:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:01:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:01:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:01:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 20:01:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:01:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:01:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:01:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:01:08 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-11-29 20:01:15 [DEBUG   ] Got command BAM from MCS: ref #669087
2018-11-29 20:01:15 [INFO    ] Finished processing BAM request
2018-11-29 20:01:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669087   8 58451 72075033 A  ERROR'
2018-11-29 20:01:15 [DEBUG   ] Got command BAM from MCS: ref #669088
2018-11-29 20:01:15 [INFO    ] Finished processing BAM request
2018-11-29 20:01:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:01:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669088   8 58451 72075037 A  ERROR'
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:01:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:01:15 [DEBUG   ] spawn_process: at 2018-11-29 20:01:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:01:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 20:01:38 [DEBUG   ] Got command BAM from MCS: ref #669090
2018-11-29 20:01:38 [INFO    ] Finished processing BAM request
2018-11-29 20:01:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669090   8 58451 72098033 A  ERROR'
2018-11-29 20:01:38 [DEBUG   ] Got command BAM from MCS: ref #669089
2018-11-29 20:01:38 [INFO    ] Finished processing BAM request
2018-11-29 20:01:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669089   8 58451 72098037 A  ERROR'
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:01:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:01:38 [DEBUG   ] spawn_process: at 2018-11-29 20:01:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:01:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:02:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:02:01 [DEBUG   ] Got command BAM from MCS: ref #669092
2018-11-29 20:02:01 [INFO    ] Finished processing BAM request
2018-11-29 20:02:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669092   8 58451 72121033 A  ERROR'
2018-11-29 20:02:01 [DEBUG   ] Got command BAM from MCS: ref #669091
2018-11-29 20:02:01 [INFO    ] Finished processing BAM request
2018-11-29 20:02:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669091   8 58451 72121037 A  ERROR'
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:02:01 [DEBUG   ] spawn_process: at 2018-11-29 20:02:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:02:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-29 20:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:02:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 20:02:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:02:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:02:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:02:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:02:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:02:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:02:09 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-29 20:02:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:02:24 [DEBUG   ] Got command BAM from MCS: ref #669097
2018-11-29 20:02:24 [INFO    ] Finished processing BAM request
2018-11-29 20:02:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669097   8 58451 72144033 A  ERROR'
2018-11-29 20:02:24 [DEBUG   ] Got command BAM from MCS: ref #669098
2018-11-29 20:02:24 [INFO    ] Finished processing BAM request
2018-11-29 20:02:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669098   8 58451 72144037 A  ERROR'
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:02:24 [DEBUG   ] spawn_process: at 2018-11-29 20:02:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:02:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:02:47 [DEBUG   ] Got command BAM from MCS: ref #669099
2018-11-29 20:02:47 [INFO    ] Finished processing BAM request
2018-11-29 20:02:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:02:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669099   8 58451 72167025 A  ERROR'
2018-11-29 20:02:47 [DEBUG   ] Got command BAM from MCS: ref #669100
2018-11-29 20:02:47 [INFO    ] Finished processing BAM request
2018-11-29 20:02:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:02:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669100   8 58451 72167029 A  ERROR'
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:02:47 [DEBUG   ] spawn_process: at 2018-11-29 20:02:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:03:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:03:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:03:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:03:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 20:03:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:03:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:03:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:03:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:03:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:03:09 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-11-29 20:03:10 [DEBUG   ] Got command BAM from MCS: ref #669101
2018-11-29 20:03:10 [INFO    ] Finished processing BAM request
2018-11-29 20:03:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669101   8 58451 72190033 A  ERROR'
2018-11-29 20:03:10 [DEBUG   ] Got command BAM from MCS: ref #669102
2018-11-29 20:03:10 [INFO    ] Finished processing BAM request
2018-11-29 20:03:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669102   8 58451 72190037 A  ERROR'
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:03:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:03:10 [DEBUG   ] spawn_process: at 2018-11-29 20:03:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:03:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:03:33 [DEBUG   ] Got command BAM from MCS: ref #669104
2018-11-29 20:03:33 [INFO    ] Finished processing BAM request
2018-11-29 20:03:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669104   8 58451 72213029 A  ERROR'
2018-11-29 20:03:33 [DEBUG   ] Got command BAM from MCS: ref #669103
2018-11-29 20:03:33 [INFO    ] Finished processing BAM request
2018-11-29 20:03:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669103   8 58451 72213033 A  ERROR'
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:03:33 [DEBUG   ] spawn_process: at 2018-11-29 20:03:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:03:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:03:56 [DEBUG   ] Got command BAM from MCS: ref #669108
2018-11-29 20:03:56 [INFO    ] Finished processing BAM request
2018-11-29 20:03:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669108   8 58451 72236025 A  ERROR'
2018-11-29 20:03:56 [DEBUG   ] Got command BAM from MCS: ref #669107
2018-11-29 20:03:56 [INFO    ] Finished processing BAM request
2018-11-29 20:03:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669107   8 58451 72236029 A  ERROR'
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:03:56 [DEBUG   ] spawn_process: at 2018-11-29 20:03:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:04:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:04:00 [DEBUG   ] Got command RPT from MCS: ref #669109
2018-11-29 20:04:00 [DEBUG   ] summary = ERROR
2018-11-29 20:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669109  13 58451 72240805 A  ERRORERROR'
2018-11-29 20:04:01 [DEBUG   ] Got command RPT from MCS: ref #669110
2018-11-29 20:04:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669110  77 58451 72241009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:04:01 [DEBUG   ] Got command RPT from MCS: ref #669111
2018-11-29 20:04:01 [DEBUG   ] summary = ERROR
2018-11-29 20:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669111  13 58451 72241213 A  ERRORERROR'
2018-11-29 20:04:01 [DEBUG   ] Got command RPT from MCS: ref #669113
2018-11-29 20:04:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669113  77 58451 72241405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:04:01 [DEBUG   ] Got command RPT from MCS: ref #669114
2018-11-29 20:04:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669114  12 58451 72241609 A  ERRORB¤ff'
2018-11-29 20:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:04:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:04:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:04:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:04:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:04:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:04:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:04:08 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-11-29 20:04:19 [DEBUG   ] Got command BAM from MCS: ref #669119
2018-11-29 20:04:19 [INFO    ] Finished processing BAM request
2018-11-29 20:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669119   8 58451 72259025 A  ERROR'
2018-11-29 20:04:19 [DEBUG   ] Got command BAM from MCS: ref #669120
2018-11-29 20:04:19 [INFO    ] Finished processing BAM request
2018-11-29 20:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669120   8 58451 72259029 A  ERROR'
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:04:19 [DEBUG   ] spawn_process: at 2018-11-29 20:04:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:04:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 20:04:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:04:42 [DEBUG   ] Got command BAM from MCS: ref #669122
2018-11-29 20:04:42 [INFO    ] Finished processing BAM request
2018-11-29 20:04:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669122   8 58451 72282029 A  ERROR'
2018-11-29 20:04:42 [DEBUG   ] Got command BAM from MCS: ref #669121
2018-11-29 20:04:42 [INFO    ] Finished processing BAM request
2018-11-29 20:04:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669121   8 58451 72282033 A  ERROR'
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:04:42 [DEBUG   ] spawn_process: at 2018-11-29 20:04:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:05:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:05:05 [DEBUG   ] Got command BAM from MCS: ref #669124
2018-11-29 20:05:05 [INFO    ] Finished processing BAM request
2018-11-29 20:05:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669124   8 58451 72305029 A  ERROR'
2018-11-29 20:05:05 [DEBUG   ] Got command BAM from MCS: ref #669123
2018-11-29 20:05:05 [INFO    ] Finished processing BAM request
2018-11-29 20:05:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669123   8 58451 72305033 A  ERROR'
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:05:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:05:05 [DEBUG   ] spawn_process: at 2018-11-29 20:05:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:05:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:05:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:05:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:05:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:05:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:05:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:05:08 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-29 20:05:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:05:28 [DEBUG   ] Got command BAM from MCS: ref #669130
2018-11-29 20:05:28 [INFO    ] Finished processing BAM request
2018-11-29 20:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669130   8 58451 72328025 A  ERROR'
2018-11-29 20:05:28 [DEBUG   ] Got command BAM from MCS: ref #669129
2018-11-29 20:05:28 [INFO    ] Finished processing BAM request
2018-11-29 20:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669129   8 58451 72328029 A  ERROR'
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:05:28 [DEBUG   ] spawn_process: at 2018-11-29 20:05:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:05:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:05:49 [DEBUG   ] Got command RPT from MCS: ref #669131
2018-11-29 20:05:49 [DEBUG   ] summary = ERROR
2018-11-29 20:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669131  13 58451 72349789 A  ERRORERROR'
2018-11-29 20:05:49 [DEBUG   ] Got command RPT from MCS: ref #669132
2018-11-29 20:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669132  77 58451 72349790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:05:51 [DEBUG   ] Got command BAM from MCS: ref #669149
2018-11-29 20:05:51 [INFO    ] Finished processing BAM request
2018-11-29 20:05:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:05:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669149   8 58451 72351033 A  ERROR'
2018-11-29 20:05:51 [DEBUG   ] Got command BAM from MCS: ref #669148
2018-11-29 20:05:51 [INFO    ] Finished processing BAM request
2018-11-29 20:05:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:05:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669148   8 58451 72351037 A  ERROR'
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:05:51 [DEBUG   ] spawn_process: at 2018-11-29 20:05:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:06:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:06:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 20:06:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 20:06:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:06:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:06:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:06:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:06:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:06:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:06:08 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-29 20:06:14 [DEBUG   ] Got command BAM from MCS: ref #669151
2018-11-29 20:06:14 [INFO    ] Finished processing BAM request
2018-11-29 20:06:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669151   8 58451 72374029 A  ERROR'
2018-11-29 20:06:14 [DEBUG   ] Got command BAM from MCS: ref #669150
2018-11-29 20:06:14 [INFO    ] Finished processing BAM request
2018-11-29 20:06:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669150   8 58451 72374033 A  ERROR'
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:06:15 [DEBUG   ] spawn_process: at 2018-11-29 20:06:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:06:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:06:37 [DEBUG   ] Got command BAM from MCS: ref #669152
2018-11-29 20:06:37 [INFO    ] Finished processing BAM request
2018-11-29 20:06:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669152   8 58451 72397025 A  ERROR'
2018-11-29 20:06:37 [DEBUG   ] Got command BAM from MCS: ref #669153
2018-11-29 20:06:37 [INFO    ] Finished processing BAM request
2018-11-29 20:06:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669153   8 58451 72397029 A  ERROR'
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:06:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:06:37 [DEBUG   ] spawn_process: at 2018-11-29 20:06:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:06:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:07:00 [DEBUG   ] Got command BAM from MCS: ref #669154
2018-11-29 20:07:00 [INFO    ] Finished processing BAM request
2018-11-29 20:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669154   8 58451 72420029 A  ERROR'
2018-11-29 20:07:00 [DEBUG   ] Got command BAM from MCS: ref #669155
2018-11-29 20:07:00 [INFO    ] Finished processing BAM request
2018-11-29 20:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669155   8 58451 72420033 A  ERROR'
2018-11-29 20:07:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:07:00 [DEBUG   ] spawn_process: at 2018-11-29 20:07:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:07:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:07:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:07:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 20:07:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:07:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:07:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:07:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:07:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:07:08 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-11-29 20:07:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:07:23 [DEBUG   ] Got command BAM from MCS: ref #669156
2018-11-29 20:07:23 [INFO    ] Finished processing BAM request
2018-11-29 20:07:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669156   8 58451 72443033 A  ERROR'
2018-11-29 20:07:23 [DEBUG   ] Got command BAM from MCS: ref #669157
2018-11-29 20:07:23 [INFO    ] Finished processing BAM request
2018-11-29 20:07:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669157   8 58451 72443037 A  ERROR'
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:07:23 [DEBUG   ] spawn_process: at 2018-11-29 20:07:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:07:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:07:46 [DEBUG   ] Got command BAM from MCS: ref #669158
2018-11-29 20:07:46 [INFO    ] Finished processing BAM request
2018-11-29 20:07:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:07:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669158   8 58451 72466029 A  ERROR'
2018-11-29 20:07:46 [DEBUG   ] Got command BAM from MCS: ref #669159
2018-11-29 20:07:46 [INFO    ] Finished processing BAM request
2018-11-29 20:07:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:07:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669159   8 58451 72466033 A  ERROR'
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:07:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:07:46 [DEBUG   ] spawn_process: at 2018-11-29 20:07:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:08:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:08:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:08:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:08:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:08:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:08:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:08:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:08:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:08:08 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-11-29 20:08:10 [DEBUG   ] Got command BAM from MCS: ref #669160
2018-11-29 20:08:10 [INFO    ] Finished processing BAM request
2018-11-29 20:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669160   8 58451 72490029 A  ERROR'
2018-11-29 20:08:10 [DEBUG   ] Got command BAM from MCS: ref #669161
2018-11-29 20:08:10 [INFO    ] Finished processing BAM request
2018-11-29 20:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669161   8 58451 72490033 A  ERROR'
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:08:10 [DEBUG   ] spawn_process: at 2018-11-29 20:08:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:08:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:08:34 [DEBUG   ] Got command BAM from MCS: ref #669167
2018-11-29 20:08:34 [INFO    ] Finished processing BAM request
2018-11-29 20:08:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669167   8 58451 72514025 A  ERROR'
2018-11-29 20:08:34 [DEBUG   ] Got command BAM from MCS: ref #669166
2018-11-29 20:08:34 [INFO    ] Finished processing BAM request
2018-11-29 20:08:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669166   8 58451 72514029 A  ERROR'
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:08:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:08:34 [DEBUG   ] spawn_process: at 2018-11-29 20:08:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:08:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:08:58 [DEBUG   ] Got command BAM from MCS: ref #669169
2018-11-29 20:08:58 [INFO    ] Finished processing BAM request
2018-11-29 20:08:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669169   8 58451 72538025 A  ERROR'
2018-11-29 20:08:58 [DEBUG   ] Got command BAM from MCS: ref #669168
2018-11-29 20:08:58 [INFO    ] Finished processing BAM request
2018-11-29 20:08:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:08:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669168   8 58451 72538029 A  ERROR'
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:08:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:08:58 [DEBUG   ] spawn_process: at 2018-11-29 20:08:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:09:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:09:00 [DEBUG   ] Got command RPT from MCS: ref #669170
2018-11-29 20:09:00 [DEBUG   ] summary = ERROR
2018-11-29 20:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669170  13 58451 72540897 A  ERRORERROR'
2018-11-29 20:09:01 [DEBUG   ] Got command RPT from MCS: ref #669171
2018-11-29 20:09:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669171  77 58451 72541089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:09:01 [DEBUG   ] Got command RPT from MCS: ref #669172
2018-11-29 20:09:01 [DEBUG   ] summary = ERROR
2018-11-29 20:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669172  13 58451 72541293 A  ERRORERROR'
2018-11-29 20:09:01 [DEBUG   ] Got command RPT from MCS: ref #669173
2018-11-29 20:09:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669173  77 58451 72541497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:09:01 [DEBUG   ] Got command RPT from MCS: ref #669174
2018-11-29 20:09:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669174  12 58451 72541701 A  ERRORB¤ff'
2018-11-29 20:09:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:09:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 20:09:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:09:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:09:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 20:09:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:09:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:09:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:09:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:09:08 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-29 20:09:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:09:22 [DEBUG   ] Got command BAM from MCS: ref #669175
2018-11-29 20:09:22 [INFO    ] Finished processing BAM request
2018-11-29 20:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669175   8 58451 72562025 A  ERROR'
2018-11-29 20:09:22 [DEBUG   ] Got command BAM from MCS: ref #669176
2018-11-29 20:09:22 [INFO    ] Finished processing BAM request
2018-11-29 20:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669176   8 58451 72562029 A  ERROR'
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:09:22 [DEBUG   ] spawn_process: at 2018-11-29 20:09:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:09:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:09:46 [DEBUG   ] Got command BAM from MCS: ref #669178
2018-11-29 20:09:46 [INFO    ] Finished processing BAM request
2018-11-29 20:09:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669178   8 58451 72586025 A  ERROR'
2018-11-29 20:09:46 [DEBUG   ] Got command BAM from MCS: ref #669177
2018-11-29 20:09:46 [INFO    ] Finished processing BAM request
2018-11-29 20:09:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669177   8 58451 72586029 A  ERROR'
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:09:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:09:46 [DEBUG   ] spawn_process: at 2018-11-29 20:09:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:10:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:10:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:10:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:10:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:10:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:10:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:10:08 [WARNING ] (13, 1, 'bot')
2018-11-29 20:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:10:08 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-11-29 20:10:10 [DEBUG   ] Got command BAM from MCS: ref #669179
2018-11-29 20:10:10 [INFO    ] Finished processing BAM request
2018-11-29 20:10:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669179   8 58451 72610033 A  ERROR'
2018-11-29 20:10:10 [DEBUG   ] Got command BAM from MCS: ref #669180
2018-11-29 20:10:10 [INFO    ] Finished processing BAM request
2018-11-29 20:10:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669180   8 58451 72610041 A  ERROR'
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:10:10 [DEBUG   ] spawn_process: at 2018-11-29 20:10:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:10:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:10:34 [DEBUG   ] Got command BAM from MCS: ref #669182
2018-11-29 20:10:34 [INFO    ] Finished processing BAM request
2018-11-29 20:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669182   8 58451 72634029 A  ERROR'
2018-11-29 20:10:34 [DEBUG   ] Got command BAM from MCS: ref #669181
2018-11-29 20:10:34 [INFO    ] Finished processing BAM request
2018-11-29 20:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669181   8 58451 72634033 A  ERROR'
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:10:34 [DEBUG   ] spawn_process: at 2018-11-29 20:10:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:10:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:10:49 [DEBUG   ] Got command RPT from MCS: ref #669183
2018-11-29 20:10:49 [DEBUG   ] summary = ERROR
2018-11-29 20:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669183  13 58451 72649785 A  ERRORERROR'
2018-11-29 20:10:49 [DEBUG   ] Got command RPT from MCS: ref #669184
2018-11-29 20:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669184  77 58451 72649786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:10:58 [DEBUG   ] Got command BAM from MCS: ref #669200
2018-11-29 20:10:58 [INFO    ] Finished processing BAM request
2018-11-29 20:10:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669200   8 58451 72658033 A  ERROR'
2018-11-29 20:10:58 [DEBUG   ] Got command BAM from MCS: ref #669201
2018-11-29 20:10:58 [INFO    ] Finished processing BAM request
2018-11-29 20:10:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669201   8 58451 72658037 A  ERROR'
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:10:58 [DEBUG   ] spawn_process: at 2018-11-29 20:10:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:11:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 20:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:11:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:11:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:11:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:11:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:11:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:11:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:11:09 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-29 20:11:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:11:22 [DEBUG   ] Got command BAM from MCS: ref #669207
2018-11-29 20:11:22 [INFO    ] Finished processing BAM request
2018-11-29 20:11:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669207   8 58451 72682029 A  ERROR'
2018-11-29 20:11:22 [DEBUG   ] Got command BAM from MCS: ref #669206
2018-11-29 20:11:22 [INFO    ] Finished processing BAM request
2018-11-29 20:11:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669206   8 58451 72682033 A  ERROR'
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:11:22 [DEBUG   ] spawn_process: at 2018-11-29 20:11:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:11:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:11:46 [DEBUG   ] Got command BAM from MCS: ref #669209
2018-11-29 20:11:46 [INFO    ] Finished processing BAM request
2018-11-29 20:11:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669209   8 58451 72706029 A  ERROR'
2018-11-29 20:11:46 [DEBUG   ] Got command BAM from MCS: ref #669208
2018-11-29 20:11:46 [INFO    ] Finished processing BAM request
2018-11-29 20:11:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669208   8 58451 72706033 A  ERROR'
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:11:46 [DEBUG   ] spawn_process: at 2018-11-29 20:11:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:12:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 20:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 20:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 20:12:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:12:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:12:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:12:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:12:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:12:09 [DEBUG   ] Finished updating board flags in 1.140 seconds
2018-11-29 20:12:10 [DEBUG   ] Got command BAM from MCS: ref #669210
2018-11-29 20:12:10 [INFO    ] Finished processing BAM request
2018-11-29 20:12:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669210   8 58451 72730037 A  ERROR'
2018-11-29 20:12:10 [DEBUG   ] Got command BAM from MCS: ref #669211
2018-11-29 20:12:10 [INFO    ] Finished processing BAM request
2018-11-29 20:12:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669211   8 58451 72730045 A  ERROR'
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:12:10 [DEBUG   ] spawn_process: at 2018-11-29 20:12:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:12:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:12:34 [DEBUG   ] Got command BAM from MCS: ref #669213
2018-11-29 20:12:34 [INFO    ] Finished processing BAM request
2018-11-29 20:12:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669213   8 58451 72754025 A  ERROR'
2018-11-29 20:12:34 [DEBUG   ] Got command BAM from MCS: ref #669212
2018-11-29 20:12:34 [INFO    ] Finished processing BAM request
2018-11-29 20:12:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669212   8 58451 72754029 A  ERROR'
2018-11-29 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:12:34 [DEBUG   ] spawn_process: at 2018-11-29 20:12:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:12:35 [DEBUG   ] spawn_process: at 2018-11-29 20:12:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:12:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:12:58 [DEBUG   ] Got command BAM from MCS: ref #669214
2018-11-29 20:12:58 [INFO    ] Finished processing BAM request
2018-11-29 20:12:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:12:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669214   8 58451 72778025 A  ERROR'
2018-11-29 20:12:58 [DEBUG   ] Got command BAM from MCS: ref #669215
2018-11-29 20:12:58 [INFO    ] Finished processing BAM request
2018-11-29 20:12:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:12:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669215   8 58451 72778029 A  ERROR'
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:12:58 [DEBUG   ] spawn_process: at 2018-11-29 20:12:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:13:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:13:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:13:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:13:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:13:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:13:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:13:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:13:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:13:09 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-29 20:13:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:13:22 [DEBUG   ] Got command BAM from MCS: ref #669217
2018-11-29 20:13:22 [INFO    ] Finished processing BAM request
2018-11-29 20:13:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669217   8 58451 72802029 A  ERROR'
2018-11-29 20:13:22 [DEBUG   ] Got command BAM from MCS: ref #669216
2018-11-29 20:13:22 [INFO    ] Finished processing BAM request
2018-11-29 20:13:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669216   8 58451 72802033 A  ERROR'
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:13:22 [DEBUG   ] spawn_process: at 2018-11-29 20:13:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:13:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:13:46 [DEBUG   ] Got command BAM from MCS: ref #669220
2018-11-29 20:13:46 [INFO    ] Finished processing BAM request
2018-11-29 20:13:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669220   8 58451 72826025 A  ERROR'
2018-11-29 20:13:46 [DEBUG   ] Got command BAM from MCS: ref #669221
2018-11-29 20:13:46 [INFO    ] Finished processing BAM request
2018-11-29 20:13:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669221   8 58451 72826029 A  ERROR'
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:13:46 [DEBUG   ] spawn_process: at 2018-11-29 20:13:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:14:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:14:00 [DEBUG   ] Got command RPT from MCS: ref #669222
2018-11-29 20:14:00 [DEBUG   ] summary = ERROR
2018-11-29 20:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669222  13 58451 72840981 A  ERRORERROR'
2018-11-29 20:14:01 [DEBUG   ] Got command RPT from MCS: ref #669223
2018-11-29 20:14:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669223  77 58451 72841173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:14:01 [DEBUG   ] Got command RPT from MCS: ref #669224
2018-11-29 20:14:01 [DEBUG   ] summary = ERROR
2018-11-29 20:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669224  13 58451 72841377 A  ERRORERROR'
2018-11-29 20:14:01 [DEBUG   ] Got command RPT from MCS: ref #669226
2018-11-29 20:14:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669226  77 58451 72841581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:14:01 [DEBUG   ] Got command RPT from MCS: ref #669228
2018-11-29 20:14:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669228  12 58451 72841785 A  ERRORB¤ff'
2018-11-29 20:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:14:10 [DEBUG   ] Got command BAM from MCS: ref #669233
2018-11-29 20:14:10 [INFO    ] Finished processing BAM request
2018-11-29 20:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669233   8 58451 72850029 A  ERROR'
2018-11-29 20:14:10 [DEBUG   ] Got command BAM from MCS: ref #669232
2018-11-29 20:14:10 [INFO    ] Finished processing BAM request
2018-11-29 20:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669232   8 58451 72850037 A  ERROR'
2018-11-29 20:14:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:14:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:14:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:14:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:14:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:14:10 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:14:10 [DEBUG   ] spawn_process: at 2018-11-29 20:14:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:14:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:14:35 [DEBUG   ] Got command BAM from MCS: ref #669238
2018-11-29 20:14:35 [INFO    ] Finished processing BAM request
2018-11-29 20:14:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669238   8 58451 72875029 A  ERROR'
2018-11-29 20:14:35 [DEBUG   ] Got command BAM from MCS: ref #669239
2018-11-29 20:14:35 [INFO    ] Finished processing BAM request
2018-11-29 20:14:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669239   8 58451 72875033 A  ERROR'
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:14:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:14:35 [DEBUG   ] spawn_process: at 2018-11-29 20:14:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:14:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:15:00 [DEBUG   ] Got command BAM from MCS: ref #669241
2018-11-29 20:15:00 [INFO    ] Finished processing BAM request
2018-11-29 20:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669241   8 58451 72900025 A  ERROR'
2018-11-29 20:15:00 [DEBUG   ] Got command BAM from MCS: ref #669240
2018-11-29 20:15:00 [INFO    ] Finished processing BAM request
2018-11-29 20:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669240   8 58451 72900029 A  ERROR'
2018-11-29 20:15:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:15:00 [DEBUG   ] spawn_process: at 2018-11-29 20:15:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:15:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:15:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 20:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:15:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:15:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:15:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:15:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:15:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:15:10 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-29 20:15:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:15:25 [DEBUG   ] Got command BAM from MCS: ref #669242
2018-11-29 20:15:25 [INFO    ] Finished processing BAM request
2018-11-29 20:15:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669242   8 58451 72925025 A  ERROR'
2018-11-29 20:15:25 [DEBUG   ] Got command BAM from MCS: ref #669243
2018-11-29 20:15:25 [INFO    ] Finished processing BAM request
2018-11-29 20:15:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669243   8 58451 72925029 A  ERROR'
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:15:25 [DEBUG   ] spawn_process: at 2018-11-29 20:15:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:15:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:15:49 [DEBUG   ] Got command RPT from MCS: ref #669246
2018-11-29 20:15:49 [DEBUG   ] summary = ERROR
2018-11-29 20:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669246  13 58451 72949902 A  ERRORERROR'
2018-11-29 20:15:49 [DEBUG   ] Got command RPT from MCS: ref #669247
2018-11-29 20:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669247  77 58451 72949902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:15:50 [DEBUG   ] Got command BAM from MCS: ref #669244
2018-11-29 20:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669244   8 58451 72950026 A  ERROR'
2018-11-29 20:15:50 [DEBUG   ] Got command BAM from MCS: ref #669245
2018-11-29 20:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669245   8 58451 72950284 A  ERROR'
2018-11-29 20:15:50 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-29 20:15:50 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-29 20:15:50 [INFO    ] Finished processing BAM request
2018-11-29 20:15:50 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-29 20:15:50 [DEBUG   ] 
2018-11-29 20:15:50 [INFO    ] Finished processing BAM request
2018-11-29 20:16:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 20:16:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:16:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:16:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:16:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:16:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:16:09 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-11-29 20:16:15 [DEBUG   ] Got command BAM from MCS: ref #669263
2018-11-29 20:16:15 [INFO    ] Finished processing BAM request
2018-11-29 20:16:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669263   8 58451 72975030 A  ERROR'
2018-11-29 20:16:15 [DEBUG   ] Got command BAM from MCS: ref #669264
2018-11-29 20:16:15 [INFO    ] Finished processing BAM request
2018-11-29 20:16:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669264   8 58451 72975034 A  ERROR'
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:16:15 [DEBUG   ] spawn_process: at 2018-11-29 20:16:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:16:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:16:40 [DEBUG   ] Got command BAM from MCS: ref #669265
2018-11-29 20:16:40 [INFO    ] Finished processing BAM request
2018-11-29 20:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669265   8 58451 73000058 A  ERROR'
2018-11-29 20:16:40 [DEBUG   ] Got command BAM from MCS: ref #669266
2018-11-29 20:16:40 [INFO    ] Finished processing BAM request
2018-11-29 20:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669266   8 58451 73000062 A  ERROR'
2018-11-29 20:16:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:16:40 [DEBUG   ] spawn_process: at 2018-11-29 20:16:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:17:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:17:05 [DEBUG   ] Got command BAM from MCS: ref #669267
2018-11-29 20:17:05 [INFO    ] Finished processing BAM request
2018-11-29 20:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669267   8 58451 73025026 A  ERROR'
2018-11-29 20:17:05 [DEBUG   ] Got command BAM from MCS: ref #669268
2018-11-29 20:17:05 [INFO    ] Finished processing BAM request
2018-11-29 20:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669268   8 58451 73025030 A  ERROR'
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:17:05 [DEBUG   ] spawn_process: at 2018-11-29 20:17:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:17:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:17:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:17:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:17:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:17:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:17:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:17:10 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-11-29 20:17:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 20:17:30 [DEBUG   ] Got command BAM from MCS: ref #669273
2018-11-29 20:17:30 [INFO    ] Finished processing BAM request
2018-11-29 20:17:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669273   8 58451 73050030 A  ERROR'
2018-11-29 20:17:30 [DEBUG   ] Got command BAM from MCS: ref #669274
2018-11-29 20:17:30 [INFO    ] Finished processing BAM request
2018-11-29 20:17:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669274   8 58451 73050034 A  ERROR'
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:17:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:17:30 [DEBUG   ] spawn_process: at 2018-11-29 20:17:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:17:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:17:55 [DEBUG   ] Got command BAM from MCS: ref #669275
2018-11-29 20:17:55 [INFO    ] Finished processing BAM request
2018-11-29 20:17:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:17:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669275   8 58451 73075049 A  ERROR'
2018-11-29 20:17:55 [DEBUG   ] Got command BAM from MCS: ref #669276
2018-11-29 20:17:55 [INFO    ] Finished processing BAM request
2018-11-29 20:17:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:17:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669276   8 58451 73075057 A  ERROR'
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:17:55 [DEBUG   ] spawn_process: at 2018-11-29 20:17:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:18:00 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 20:18:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:18:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:18:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:18:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:18:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:18:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:18:09 [DEBUG   ] Finished updating board flags in 1.258 seconds
2018-11-29 20:18:20 [DEBUG   ] Got command BAM from MCS: ref #669277
2018-11-29 20:18:20 [INFO    ] Finished processing BAM request
2018-11-29 20:18:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669277   8 58451 73100029 A  ERROR'
2018-11-29 20:18:20 [DEBUG   ] Got command BAM from MCS: ref #669278
2018-11-29 20:18:20 [INFO    ] Finished processing BAM request
2018-11-29 20:18:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669278   8 58451 73100033 A  ERROR'
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:18:20 [DEBUG   ] spawn_process: at 2018-11-29 20:18:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:18:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:18:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:18:45 [DEBUG   ] Got command BAM from MCS: ref #669279
2018-11-29 20:18:45 [INFO    ] Finished processing BAM request
2018-11-29 20:18:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669279   8 58451 73125029 A  ERROR'
2018-11-29 20:18:45 [DEBUG   ] Got command BAM from MCS: ref #669280
2018-11-29 20:18:45 [INFO    ] Finished processing BAM request
2018-11-29 20:18:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:18:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669280   8 58451 73125033 A  ERROR'
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:18:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:18:45 [DEBUG   ] spawn_process: at 2018-11-29 20:18:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:19:01 [DEBUG   ] Got command RPT from MCS: ref #669281
2018-11-29 20:19:01 [DEBUG   ] summary = ERROR
2018-11-29 20:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669281  13 58451 73141069 A  ERRORERROR'
2018-11-29 20:19:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:19:01 [DEBUG   ] Got command RPT from MCS: ref #669282
2018-11-29 20:19:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669282  77 58451 73141265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:19:01 [DEBUG   ] Got command RPT from MCS: ref #669283
2018-11-29 20:19:01 [DEBUG   ] summary = ERROR
2018-11-29 20:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669283  13 58451 73141465 A  ERRORERROR'
2018-11-29 20:19:01 [DEBUG   ] Got command RPT from MCS: ref #669284
2018-11-29 20:19:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669284  77 58451 73141669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:19:01 [DEBUG   ] Got command RPT from MCS: ref #669285
2018-11-29 20:19:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669285  12 58451 73141873 A  ERRORB£ff'
2018-11-29 20:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-29 20:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:19:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:19:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:19:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:19:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:19:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:19:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:19:09 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-29 20:19:10 [DEBUG   ] Got command BAM from MCS: ref #669286
2018-11-29 20:19:10 [INFO    ] Finished processing BAM request
2018-11-29 20:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669286   8 58451 73150033 A  ERROR'
2018-11-29 20:19:10 [DEBUG   ] Got command BAM from MCS: ref #669287
2018-11-29 20:19:10 [INFO    ] Finished processing BAM request
2018-11-29 20:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669287   8 58451 73150037 A  ERROR'
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:19:10 [DEBUG   ] spawn_process: at 2018-11-29 20:19:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:19:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:19:35 [DEBUG   ] Got command BAM from MCS: ref #669289
2018-11-29 20:19:35 [INFO    ] Finished processing BAM request
2018-11-29 20:19:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669289   8 58451 73175025 A  ERROR'
2018-11-29 20:19:35 [DEBUG   ] Got command BAM from MCS: ref #669288
2018-11-29 20:19:35 [INFO    ] Finished processing BAM request
2018-11-29 20:19:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669288   8 58451 73175029 A  ERROR'
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:19:35 [DEBUG   ] spawn_process: at 2018-11-29 20:19:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:19:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:20:00 [DEBUG   ] Got command BAM from MCS: ref #669291
2018-11-29 20:20:00 [INFO    ] Finished processing BAM request
2018-11-29 20:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669291   8 58451 73200033 A  ERROR'
2018-11-29 20:20:00 [DEBUG   ] Got command BAM from MCS: ref #669290
2018-11-29 20:20:00 [INFO    ] Finished processing BAM request
2018-11-29 20:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669290   8 58451 73200037 A  ERROR'
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:20:00 [DEBUG   ] spawn_process: at 2018-11-29 20:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:20:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 20:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:20:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:20:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:20:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:20:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:20:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:20:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:20:09 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-29 20:20:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 20:20:26 [DEBUG   ] Got command BAM from MCS: ref #669296
2018-11-29 20:20:26 [INFO    ] Finished processing BAM request
2018-11-29 20:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669296   8 58451 73226033 A  ERROR'
2018-11-29 20:20:26 [DEBUG   ] Got command BAM from MCS: ref #669297
2018-11-29 20:20:26 [INFO    ] Finished processing BAM request
2018-11-29 20:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669297   8 58451 73226037 A  ERROR'
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:20:26 [DEBUG   ] spawn_process: at 2018-11-29 20:20:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:20:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 20:20:49 [DEBUG   ] Got command RPT from MCS: ref #669298
2018-11-29 20:20:49 [DEBUG   ] summary = ERROR
2018-11-29 20:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669298  13 58451 73249789 A  ERRORERROR'
2018-11-29 20:20:49 [DEBUG   ] Got command RPT from MCS: ref #669299
2018-11-29 20:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669299  77 58451 73249790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:20:52 [DEBUG   ] Got command BAM from MCS: ref #669316
2018-11-29 20:20:52 [INFO    ] Finished processing BAM request
2018-11-29 20:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669316   8 58451 73252025 A  ERROR'
2018-11-29 20:20:52 [DEBUG   ] Got command BAM from MCS: ref #669315
2018-11-29 20:20:52 [INFO    ] Finished processing BAM request
2018-11-29 20:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669315   8 58451 73252029 A  ERROR'
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:20:52 [DEBUG   ] spawn_process: at 2018-11-29 20:20:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:21:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 20:21:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 20:21:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 20:21:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:21:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:21:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:21:09 [WARNING ] (13, 1, 'bot')
2018-11-29 20:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:21:09 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-29 20:21:18 [DEBUG   ] Got command BAM from MCS: ref #669317
2018-11-29 20:21:18 [INFO    ] Finished processing BAM request
2018-11-29 20:21:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669317   8 58451 73278025 A  ERROR'
2018-11-29 20:21:18 [DEBUG   ] Got command BAM from MCS: ref #669318
2018-11-29 20:21:18 [INFO    ] Finished processing BAM request
2018-11-29 20:21:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669318   8 58451 73278029 A  ERROR'
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:21:18 [DEBUG   ] spawn_process: at 2018-11-29 20:21:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:21:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 20:21:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:21:44 [DEBUG   ] Got command BAM from MCS: ref #669319
2018-11-29 20:21:44 [INFO    ] Finished processing BAM request
2018-11-29 20:21:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669319   8 58451 73304029 A  ERROR'
2018-11-29 20:21:44 [DEBUG   ] Got command BAM from MCS: ref #669320
2018-11-29 20:21:44 [INFO    ] Finished processing BAM request
2018-11-29 20:21:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669320   8 58451 73304033 A  ERROR'
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:21:44 [DEBUG   ] spawn_process: at 2018-11-29 20:21:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:22:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:22:10 [DEBUG   ] Got command BAM from MCS: ref #669322
2018-11-29 20:22:10 [INFO    ] Finished processing BAM request
2018-11-29 20:22:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669322   8 58451 73330041 A  ERROR'
2018-11-29 20:22:10 [DEBUG   ] Got command BAM from MCS: ref #669321
2018-11-29 20:22:10 [INFO    ] Finished processing BAM request
2018-11-29 20:22:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669321   8 58451 73330049 A  ERROR'
2018-11-29 20:22:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:22:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:22:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:22:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:22:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:22:10 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:22:10 [DEBUG   ] spawn_process: at 2018-11-29 20:22:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:22:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:22:35 [DEBUG   ] Got command STP from MCS: ref #669324
2018-11-29 20:22:35 [INFO    ] Finished processing BAM request
2018-11-29 20:22:35 [INFO    ] Shutdown the adder chain on beam #2
2018-11-29 20:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   669324   8 58451 73355121 A  ERROR'
2018-11-29 20:22:35 [DEBUG   ] Got command STP from MCS: ref #669323
2018-11-29 20:22:35 [INFO    ] Finished processing BAM request
2018-11-29 20:22:35 [INFO    ] Shutdown the adder chain on beam #3
2018-11-29 20:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   669323   8 58451 73355125 A  ERROR'
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:22:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:22:35 [DEBUG   ] spawn_process: at 2018-11-29 20:22:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:22:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:23:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 20:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:23:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 20:23:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:23:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:23:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:23:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:23:10 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-11-29 20:23:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 20:23:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:24:01 [DEBUG   ] Got command RPT from MCS: ref #669331
2018-11-29 20:24:01 [DEBUG   ] summary = ERROR
2018-11-29 20:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669331  13 58451 73441149 A  ERRORERROR'
2018-11-29 20:24:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:24:01 [DEBUG   ] Got command RPT from MCS: ref #669332
2018-11-29 20:24:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669332  77 58451 73441353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:24:01 [DEBUG   ] Got command RPT from MCS: ref #669333
2018-11-29 20:24:01 [DEBUG   ] summary = ERROR
2018-11-29 20:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669333  13 58451 73441557 A  ERRORERROR'
2018-11-29 20:24:01 [DEBUG   ] Got command RPT from MCS: ref #669335
2018-11-29 20:24:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669335  77 58451 73441749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:24:01 [DEBUG   ] Got command RPT from MCS: ref #669336
2018-11-29 20:24:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669336  12 58451 73441953 A  ERRORBžff'
2018-11-29 20:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:24:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:24:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:24:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:24:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:24:10 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-29 20:24:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:24:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:25:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:25:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:25:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:25:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:25:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:25:10 [DEBUG   ] Finished updating board flags in 1.062 seconds
2018-11-29 20:25:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:25:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:25:49 [DEBUG   ] Got command RPT from MCS: ref #669341
2018-11-29 20:25:49 [DEBUG   ] summary = ERROR
2018-11-29 20:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669341  13 58451 73549797 A  ERRORERROR'
2018-11-29 20:25:49 [DEBUG   ] Got command RPT from MCS: ref #669342
2018-11-29 20:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669342  77 58451 73549798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:26:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:26:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 20:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:26:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 20:26:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:26:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:26:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:26:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:26:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:26:11 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-29 20:26:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:26:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:27:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:27:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:27:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:27:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:27:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:27:10 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-29 20:27:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:27:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:28:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:28:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:28:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:28:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:28:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:28:10 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-11-29 20:28:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:28:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:29:01 [DEBUG   ] Got command RPT from MCS: ref #669362
2018-11-29 20:29:01 [DEBUG   ] summary = ERROR
2018-11-29 20:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669362  13 58451 73741229 A  ERRORERROR'
2018-11-29 20:29:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:29:01 [DEBUG   ] Got command RPT from MCS: ref #669363
2018-11-29 20:29:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669363  77 58451 73741433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:29:01 [DEBUG   ] Got command RPT from MCS: ref #669364
2018-11-29 20:29:01 [DEBUG   ] summary = ERROR
2018-11-29 20:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669364  13 58451 73741637 A  ERRORERROR'
2018-11-29 20:29:01 [DEBUG   ] Got command RPT from MCS: ref #669365
2018-11-29 20:29:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669365  77 58451 73741841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:29:02 [DEBUG   ] Got command RPT from MCS: ref #669366
2018-11-29 20:29:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669366  12 58451 73742033 A  ERRORB˜™š'
2018-11-29 20:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:29:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:29:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:29:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:29:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:29:10 [DEBUG   ] Finished updating board flags in 1.144 seconds
2018-11-29 20:29:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:29:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:30:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:30:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:30:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:30:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:30:10 [WARNING ] (13, 1, 'bot')
2018-11-29 20:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:30:10 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-11-29 20:30:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:30:49 [DEBUG   ] Got command RPT from MCS: ref #669371
2018-11-29 20:30:49 [DEBUG   ] summary = ERROR
2018-11-29 20:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669371  13 58451 73849797 A  ERRORERROR'
2018-11-29 20:30:49 [DEBUG   ] Got command RPT from MCS: ref #669372
2018-11-29 20:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669372  77 58451 73849798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:31:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:31:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:31:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:31:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:31:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:31:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:31:11 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-29 20:31:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:31:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:32:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:32:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 20:32:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:32:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:32:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:32:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:32:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:32:11 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-29 20:32:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:32:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:33:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:33:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:33:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:33:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:33:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:33:11 [DEBUG   ] Finished updating board flags in 1.342 seconds
2018-11-29 20:33:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:33:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:34:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:34:01 [DEBUG   ] Got command RPT from MCS: ref #669394
2018-11-29 20:34:01 [DEBUG   ] summary = ERROR
2018-11-29 20:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669394  13 58451 74041317 A  ERRORERROR'
2018-11-29 20:34:01 [DEBUG   ] Got command RPT from MCS: ref #669395
2018-11-29 20:34:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669395  77 58451 74041525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:34:01 [DEBUG   ] Got command RPT from MCS: ref #669396
2018-11-29 20:34:01 [DEBUG   ] summary = ERROR
2018-11-29 20:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669396  13 58451 74041725 A  ERRORERROR'
2018-11-29 20:34:01 [DEBUG   ] Got command RPT from MCS: ref #669398
2018-11-29 20:34:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669398  77 58451 74041929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:34:02 [DEBUG   ] Got command RPT from MCS: ref #669399
2018-11-29 20:34:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669399  12 58451 74042121 A  ERRORB—™š'
2018-11-29 20:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:34:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:34:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:34:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:34:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:34:11 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-29 20:34:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:34:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:35:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:35:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:35:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:35:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:35:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:35:11 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-29 20:35:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:35:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:35:49 [DEBUG   ] Got command RPT from MCS: ref #669408
2018-11-29 20:35:49 [DEBUG   ] summary = ERROR
2018-11-29 20:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669408  13 58451 74149797 A  ERRORERROR'
2018-11-29 20:35:49 [DEBUG   ] Got command RPT from MCS: ref #669409
2018-11-29 20:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669409  77 58451 74149798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:36:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:36:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:36:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:36:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:36:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:36:11 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-29 20:36:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:36:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 20:37:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 20:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:37:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:37:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:37:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:37:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:37:11 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-29 20:37:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 20:37:24 [DEBUG   ] Got command BAM from MCS: ref #669429
2018-11-29 20:37:24 [INFO    ] Finished processing BAM request
2018-11-29 20:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669429   8 58451 74244025 A  ERROR'
2018-11-29 20:37:24 [DEBUG   ] Got command BAM from MCS: ref #669430
2018-11-29 20:37:24 [INFO    ] Finished processing BAM request
2018-11-29 20:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669430   8 58451 74244029 A  ERROR'
2018-11-29 20:37:24 [DEBUG   ] Got command DRX from MCS: ref #669431
2018-11-29 20:37:24 [INFO    ] sending drx command to lwa16
2018-11-29 20:37:24 [DEBUG   ] run_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 9']
2018-11-29 20:37:24 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 20:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   669431   8 58451 74244105 A  ERROR'
2018-11-29 20:37:24 [DEBUG   ] Got command DRX from MCS: ref #669432
2018-11-29 20:37:24 [INFO    ] sending drx command to lwa34
2018-11-29 20:37:24 [DEBUG   ] run_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 64500000.0 7 9 9']
2018-11-29 20:37:24 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 20:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   669432   8 58451 74244109 A  ERROR'
2018-11-29 20:37:24 [DEBUG   ] Got command DRX from MCS: ref #669433
2018-11-29 20:37:24 [INFO    ] sending drx command to lwa16
2018-11-29 20:37:24 [DEBUG   ] run_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 9']
2018-11-29 20:37:24 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 20:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   669433   8 58451 74244113 A  ERROR'
2018-11-29 20:37:24 [DEBUG   ] Got command DRX from MCS: ref #669434
2018-11-29 20:37:24 [INFO    ] sending drx command to lwa34
2018-11-29 20:37:24 [DEBUG   ] run_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 79200000.0 7 9 9']
2018-11-29 20:37:24 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 20:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   669434   8 58451 74244117 A  ERROR'
2018-11-29 20:37:24 [INFO    ] Finished starting DRX
2018-11-29 20:37:24 [INFO    ] Finished starting DRX
2018-11-29 20:37:24 [INFO    ] Finished starting DRX
2018-11-29 20:37:24 [INFO    ] Finished starting DRX
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:37:24 [DEBUG   ] spawn_process: at 2018-11-29 20:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:37:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:38:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:38:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:38:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:38:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:38:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:38:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:38:12 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-11-29 20:38:13 [DEBUG   ] Got command BAM from MCS: ref #669438
2018-11-29 20:38:13 [INFO    ] Finished processing BAM request
2018-11-29 20:38:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669438   8 58451 74293029 A  ERROR'
2018-11-29 20:38:13 [DEBUG   ] Got command BAM from MCS: ref #669437
2018-11-29 20:38:13 [INFO    ] Finished processing BAM request
2018-11-29 20:38:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669437   8 58451 74293033 A  ERROR'
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:38:13 [DEBUG   ] spawn_process: at 2018-11-29 20:38:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:38:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:38:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:39:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:39:01 [DEBUG   ] Got command RPT from MCS: ref #669445
2018-11-29 20:39:01 [DEBUG   ] summary = ERROR
2018-11-29 20:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669445  13 58451 74341405 A  ERRORERROR'
2018-11-29 20:39:01 [DEBUG   ] Got command RPT from MCS: ref #669446
2018-11-29 20:39:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669446  77 58451 74341609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:39:01 [DEBUG   ] Got command RPT from MCS: ref #669447
2018-11-29 20:39:01 [DEBUG   ] summary = ERROR
2018-11-29 20:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669447  13 58451 74341813 A  ERRORERROR'
2018-11-29 20:39:02 [DEBUG   ] Got command RPT from MCS: ref #669448
2018-11-29 20:39:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669448  77 58451 74342017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:39:02 [DEBUG   ] Got command BAM from MCS: ref #669443
2018-11-29 20:39:02 [INFO    ] Finished processing BAM request
2018-11-29 20:39:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669443   8 58451 74342033 A  ERROR'
2018-11-29 20:39:02 [DEBUG   ] Got command BAM from MCS: ref #669444
2018-11-29 20:39:02 [INFO    ] Finished processing BAM request
2018-11-29 20:39:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669444   8 58451 74342037 A  ERROR'
2018-11-29 20:39:02 [DEBUG   ] Got command RPT from MCS: ref #669449
2018-11-29 20:39:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669449  12 58451 74342217 A  ERRORB™™š'
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:39:02 [DEBUG   ] spawn_process: at 2018-11-29 20:39:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 20:39:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-29 20:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:39:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 20:39:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:39:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:39:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:39:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:39:11 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-29 20:39:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:39:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:39:51 [DEBUG   ] Got command BAM from MCS: ref #669451
2018-11-29 20:39:51 [INFO    ] Finished processing BAM request
2018-11-29 20:39:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669451   8 58451 74391029 A  ERROR'
2018-11-29 20:39:51 [DEBUG   ] Got command BAM from MCS: ref #669450
2018-11-29 20:39:51 [INFO    ] Finished processing BAM request
2018-11-29 20:39:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669450   8 58451 74391033 A  ERROR'
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:39:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:39:51 [DEBUG   ] spawn_process: at 2018-11-29 20:39:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:40:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:40:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 20:40:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:40:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 20:40:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:40:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:40:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:40:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:40:11 [DEBUG   ] Finished updating board flags in 1.304 seconds
2018-11-29 20:40:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:40:40 [DEBUG   ] Got command BAM from MCS: ref #669452
2018-11-29 20:40:40 [INFO    ] Finished processing BAM request
2018-11-29 20:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669452   8 58451 74440029 A  ERROR'
2018-11-29 20:40:40 [DEBUG   ] Got command BAM from MCS: ref #669453
2018-11-29 20:40:40 [INFO    ] Finished processing BAM request
2018-11-29 20:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669453   8 58451 74440033 A  ERROR'
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:40:40 [DEBUG   ] spawn_process: at 2018-11-29 20:40:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:40:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:40:49 [DEBUG   ] Got command RPT from MCS: ref #669454
2018-11-29 20:40:49 [DEBUG   ] summary = ERROR
2018-11-29 20:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669454  13 58451 74449789 A  ERRORERROR'
2018-11-29 20:40:49 [DEBUG   ] Got command RPT from MCS: ref #669455
2018-11-29 20:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669455  77 58451 74449790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:41:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:41:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:41:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:41:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:41:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:41:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:41:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:41:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:41:12 [DEBUG   ] Finished updating board flags in 1.742 seconds
2018-11-29 20:41:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:41:29 [DEBUG   ] Got command BAM from MCS: ref #669475
2018-11-29 20:41:29 [INFO    ] Finished processing BAM request
2018-11-29 20:41:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669475   8 58451 74489029 A  ERROR'
2018-11-29 20:41:29 [DEBUG   ] Got command BAM from MCS: ref #669476
2018-11-29 20:41:29 [INFO    ] Finished processing BAM request
2018-11-29 20:41:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669476   8 58451 74489033 A  ERROR'
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:41:29 [DEBUG   ] spawn_process: at 2018-11-29 20:41:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:41:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:42:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:42:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:42:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:42:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:42:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:42:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:42:11 [WARNING ] (13, 1, 'bot')
2018-11-29 20:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:42:11 [DEBUG   ] Finished updating board flags in 0.968 seconds
2018-11-29 20:42:18 [DEBUG   ] Got command BAM from MCS: ref #669478
2018-11-29 20:42:18 [INFO    ] Finished processing BAM request
2018-11-29 20:42:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669478   8 58451 74538033 A  ERROR'
2018-11-29 20:42:18 [DEBUG   ] Got command BAM from MCS: ref #669477
2018-11-29 20:42:18 [INFO    ] Finished processing BAM request
2018-11-29 20:42:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669477   8 58451 74538037 A  ERROR'
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:42:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:42:18 [DEBUG   ] spawn_process: at 2018-11-29 20:42:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:42:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:42:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:43:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:43:06 [DEBUG   ] Got command BAM from MCS: ref #669480
2018-11-29 20:43:06 [INFO    ] Finished processing BAM request
2018-11-29 20:43:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669480   8 58451 74586025 A  ERROR'
2018-11-29 20:43:06 [DEBUG   ] Got command BAM from MCS: ref #669479
2018-11-29 20:43:06 [INFO    ] Finished processing BAM request
2018-11-29 20:43:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669479   8 58451 74586029 A  ERROR'
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:43:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:43:06 [DEBUG   ] spawn_process: at 2018-11-29 20:43:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:43:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:43:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:43:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:43:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:43:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:43:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:43:12 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-11-29 20:43:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:43:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:43:54 [DEBUG   ] Got command BAM from MCS: ref #669484
2018-11-29 20:43:54 [INFO    ] Finished processing BAM request
2018-11-29 20:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669484   8 58451 74634033 A  ERROR'
2018-11-29 20:43:54 [DEBUG   ] Got command BAM from MCS: ref #669483
2018-11-29 20:43:54 [INFO    ] Finished processing BAM request
2018-11-29 20:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669483   8 58451 74634037 A  ERROR'
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:43:54 [DEBUG   ] spawn_process: at 2018-11-29 20:43:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:44:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:44:01 [DEBUG   ] Got command RPT from MCS: ref #669485
2018-11-29 20:44:01 [DEBUG   ] summary = ERROR
2018-11-29 20:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669485  13 58451 74641497 A  ERRORERROR'
2018-11-29 20:44:01 [DEBUG   ] Got command RPT from MCS: ref #669486
2018-11-29 20:44:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669486  77 58451 74641701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:44:01 [DEBUG   ] Got command RPT from MCS: ref #669487
2018-11-29 20:44:01 [DEBUG   ] summary = ERROR
2018-11-29 20:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669487  13 58451 74641909 A  ERRORERROR'
2018-11-29 20:44:02 [DEBUG   ] Got command RPT from MCS: ref #669489
2018-11-29 20:44:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669489  77 58451 74642101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:44:02 [DEBUG   ] Got command RPT from MCS: ref #669490
2018-11-29 20:44:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669490  12 58451 74642305 A  ERRORB¢ff'
2018-11-29 20:44:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:44:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:44:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:44:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:44:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:44:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:44:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:44:12 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-29 20:44:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:44:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:44:42 [DEBUG   ] Got command BAM from MCS: ref #669500
2018-11-29 20:44:42 [INFO    ] Finished processing BAM request
2018-11-29 20:44:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669500   8 58451 74682029 A  ERROR'
2018-11-29 20:44:42 [DEBUG   ] Got command BAM from MCS: ref #669499
2018-11-29 20:44:42 [INFO    ] Finished processing BAM request
2018-11-29 20:44:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669499   8 58451 74682033 A  ERROR'
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:44:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:44:42 [DEBUG   ] spawn_process: at 2018-11-29 20:44:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:45:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:45:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:45:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:45:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:45:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:45:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:45:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:45:12 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-11-29 20:45:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:45:30 [DEBUG   ] Got command BAM from MCS: ref #669501
2018-11-29 20:45:30 [INFO    ] Finished processing BAM request
2018-11-29 20:45:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669501   8 58451 74730029 A  ERROR'
2018-11-29 20:45:30 [DEBUG   ] Got command BAM from MCS: ref #669502
2018-11-29 20:45:30 [INFO    ] Finished processing BAM request
2018-11-29 20:45:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669502   8 58451 74730033 A  ERROR'
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:45:30 [DEBUG   ] spawn_process: at 2018-11-29 20:45:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:45:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:45:49 [DEBUG   ] Got command RPT from MCS: ref #669503
2018-11-29 20:45:49 [DEBUG   ] summary = ERROR
2018-11-29 20:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669503  13 58451 74749801 A  ERRORERROR'
2018-11-29 20:45:49 [DEBUG   ] Got command RPT from MCS: ref #669504
2018-11-29 20:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669504  77 58451 74749802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:46:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 20:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2018-11-29 20:46:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 20:46:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:46:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:46:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:46:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:46:12 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-29 20:46:18 [DEBUG   ] Got command BAM from MCS: ref #669520
2018-11-29 20:46:18 [INFO    ] Finished processing BAM request
2018-11-29 20:46:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669520   8 58451 74778029 A  ERROR'
2018-11-29 20:46:18 [DEBUG   ] Got command BAM from MCS: ref #669521
2018-11-29 20:46:18 [INFO    ] Finished processing BAM request
2018-11-29 20:46:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669521   8 58451 74778033 A  ERROR'
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:46:18 [DEBUG   ] spawn_process: at 2018-11-29 20:46:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:46:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:46:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:47:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:47:06 [DEBUG   ] Got command BAM from MCS: ref #669523
2018-11-29 20:47:06 [INFO    ] Finished processing BAM request
2018-11-29 20:47:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:47:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669523   8 58451 74826033 A  ERROR'
2018-11-29 20:47:06 [DEBUG   ] Got command BAM from MCS: ref #669522
2018-11-29 20:47:06 [INFO    ] Finished processing BAM request
2018-11-29 20:47:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:47:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669522   8 58451 74826037 A  ERROR'
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:47:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:47:06 [DEBUG   ] spawn_process: at 2018-11-29 20:47:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:47:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:47:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:47:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:47:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:47:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:47:13 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-29 20:47:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:47:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:47:54 [DEBUG   ] Got command BAM from MCS: ref #669529
2018-11-29 20:47:54 [INFO    ] Finished processing BAM request
2018-11-29 20:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669529   8 58451 74874033 A  ERROR'
2018-11-29 20:47:54 [DEBUG   ] Got command BAM from MCS: ref #669528
2018-11-29 20:47:54 [INFO    ] Finished processing BAM request
2018-11-29 20:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669528   8 58451 74874037 A  ERROR'
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:47:54 [DEBUG   ] spawn_process: at 2018-11-29 20:47:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:48:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 20:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:48:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 20:48:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:48:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:48:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:48:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:48:12 [DEBUG   ] Finished updating board flags in 1.310 seconds
2018-11-29 20:48:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:48:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:48:42 [DEBUG   ] Got command BAM from MCS: ref #669531
2018-11-29 20:48:42 [INFO    ] Finished processing BAM request
2018-11-29 20:48:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669531   8 58451 74922033 A  ERROR'
2018-11-29 20:48:42 [DEBUG   ] Got command BAM from MCS: ref #669530
2018-11-29 20:48:42 [INFO    ] Finished processing BAM request
2018-11-29 20:48:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:48:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669530   8 58451 74922037 A  ERROR'
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:48:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:48:42 [DEBUG   ] spawn_process: at 2018-11-29 20:48:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:49:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:49:01 [DEBUG   ] Got command RPT from MCS: ref #669532
2018-11-29 20:49:01 [DEBUG   ] summary = ERROR
2018-11-29 20:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669532  13 58451 74941585 A  ERRORERROR'
2018-11-29 20:49:01 [DEBUG   ] Got command RPT from MCS: ref #669533
2018-11-29 20:49:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669533  77 58451 74941789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:49:01 [DEBUG   ] Got command RPT from MCS: ref #669534
2018-11-29 20:49:01 [DEBUG   ] summary = ERROR
2018-11-29 20:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669534  13 58451 74941981 A  ERRORERROR'
2018-11-29 20:49:02 [DEBUG   ] Got command RPT from MCS: ref #669535
2018-11-29 20:49:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669535  77 58451 74942185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:49:02 [DEBUG   ] Got command RPT from MCS: ref #669536
2018-11-29 20:49:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669536  12 58451 74942389 A  ERRORB¢ff'
2018-11-29 20:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:49:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:49:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:49:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:49:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:49:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:49:12 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-29 20:49:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:49:30 [DEBUG   ] Got command BAM from MCS: ref #669538
2018-11-29 20:49:30 [INFO    ] Finished processing BAM request
2018-11-29 20:49:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669538   8 58451 74970033 A  ERROR'
2018-11-29 20:49:30 [DEBUG   ] Got command BAM from MCS: ref #669537
2018-11-29 20:49:30 [INFO    ] Finished processing BAM request
2018-11-29 20:49:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669537   8 58451 74970037 A  ERROR'
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:49:30 [DEBUG   ] spawn_process: at 2018-11-29 20:49:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:49:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:50:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:50:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:50:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:50:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 20:50:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 20:50:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:50:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 20:50:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:50:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:50:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:50:12 [WARNING ] (13, 1, 'bot')
2018-11-29 20:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:50:12 [DEBUG   ] Finished updating board flags in 1.125 seconds
2018-11-29 20:50:18 [DEBUG   ] Got command BAM from MCS: ref #669544
2018-11-29 20:50:18 [INFO    ] Finished processing BAM request
2018-11-29 20:50:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669544   8 58451 75018029 A  ERROR'
2018-11-29 20:50:18 [DEBUG   ] Got command BAM from MCS: ref #669543
2018-11-29 20:50:18 [INFO    ] Finished processing BAM request
2018-11-29 20:50:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669543   8 58451 75018033 A  ERROR'
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:50:18 [DEBUG   ] spawn_process: at 2018-11-29 20:50:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:50:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:50:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:50:49 [DEBUG   ] Got command RPT from MCS: ref #669545
2018-11-29 20:50:49 [DEBUG   ] summary = ERROR
2018-11-29 20:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669545  13 58451 75049797 A  ERRORERROR'
2018-11-29 20:50:49 [DEBUG   ] Got command RPT from MCS: ref #669546
2018-11-29 20:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669546  77 58451 75049798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:51:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:51:06 [DEBUG   ] Got command BAM from MCS: ref #669563
2018-11-29 20:51:06 [INFO    ] Finished processing BAM request
2018-11-29 20:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669563   8 58451 75066029 A  ERROR'
2018-11-29 20:51:06 [DEBUG   ] Got command BAM from MCS: ref #669562
2018-11-29 20:51:06 [INFO    ] Finished processing BAM request
2018-11-29 20:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669562   8 58451 75066033 A  ERROR'
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:51:06 [DEBUG   ] spawn_process: at 2018-11-29 20:51:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:51:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:51:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 20:51:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:51:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:51:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:51:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:51:13 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-11-29 20:51:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:51:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:51:54 [DEBUG   ] Got command BAM from MCS: ref #669564
2018-11-29 20:51:54 [INFO    ] Finished processing BAM request
2018-11-29 20:51:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669564   8 58451 75114025 A  ERROR'
2018-11-29 20:51:54 [DEBUG   ] Got command BAM from MCS: ref #669565
2018-11-29 20:51:54 [INFO    ] Finished processing BAM request
2018-11-29 20:51:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669565   8 58451 75114029 A  ERROR'
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:51:54 [DEBUG   ] spawn_process: at 2018-11-29 20:51:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:52:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:52:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 20:52:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 20:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:52:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:52:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:52:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:52:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:52:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:52:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:52:13 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-29 20:52:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:52:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:52:42 [DEBUG   ] Got command BAM from MCS: ref #669566
2018-11-29 20:52:42 [INFO    ] Finished processing BAM request
2018-11-29 20:52:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669566   8 58451 75162025 A  ERROR'
2018-11-29 20:52:42 [DEBUG   ] Got command BAM from MCS: ref #669567
2018-11-29 20:52:42 [INFO    ] Finished processing BAM request
2018-11-29 20:52:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669567   8 58451 75162029 A  ERROR'
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:52:42 [DEBUG   ] spawn_process: at 2018-11-29 20:52:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:53:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:53:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:53:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:53:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:53:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:53:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:53:13 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-29 20:53:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:53:30 [DEBUG   ] Got command BAM from MCS: ref #669572
2018-11-29 20:53:30 [INFO    ] Finished processing BAM request
2018-11-29 20:53:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669572   8 58451 75210029 A  ERROR'
2018-11-29 20:53:30 [DEBUG   ] Got command BAM from MCS: ref #669573
2018-11-29 20:53:30 [INFO    ] Finished processing BAM request
2018-11-29 20:53:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669573   8 58451 75210033 A  ERROR'
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:53:30 [DEBUG   ] spawn_process: at 2018-11-29 20:53:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:53:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:54:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 20:54:01 [DEBUG   ] Got command RPT from MCS: ref #669576
2018-11-29 20:54:01 [DEBUG   ] summary = ERROR
2018-11-29 20:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669576  13 58451 75241673 A  ERRORERROR'
2018-11-29 20:54:01 [DEBUG   ] Got command RPT from MCS: ref #669577
2018-11-29 20:54:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669577  77 58451 75241865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:54:02 [DEBUG   ] Got command RPT from MCS: ref #669578
2018-11-29 20:54:02 [DEBUG   ] summary = ERROR
2018-11-29 20:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669578  13 58451 75242069 A  ERRORERROR'
2018-11-29 20:54:02 [DEBUG   ] Got command RPT from MCS: ref #669579
2018-11-29 20:54:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669579  77 58451 75242273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:54:02 [DEBUG   ] Got command RPT from MCS: ref #669581
2018-11-29 20:54:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669581  12 58451 75242465 A  ERRORB£ff'
2018-11-29 20:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 20:54:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 20:54:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:54:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:54:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:54:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:54:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:54:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:54:13 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-29 20:54:18 [DEBUG   ] Got command BAM from MCS: ref #669586
2018-11-29 20:54:18 [INFO    ] Finished processing BAM request
2018-11-29 20:54:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669586   8 58451 75258025 A  ERROR'
2018-11-29 20:54:18 [DEBUG   ] Got command BAM from MCS: ref #669587
2018-11-29 20:54:18 [INFO    ] Finished processing BAM request
2018-11-29 20:54:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669587   8 58451 75258029 A  ERROR'
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:54:18 [DEBUG   ] spawn_process: at 2018-11-29 20:54:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:54:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:54:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:55:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 20:55:06 [DEBUG   ] Got command BAM from MCS: ref #669588
2018-11-29 20:55:06 [INFO    ] Finished processing BAM request
2018-11-29 20:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669588   8 58451 75306033 A  ERROR'
2018-11-29 20:55:06 [DEBUG   ] Got command BAM from MCS: ref #669589
2018-11-29 20:55:06 [INFO    ] Finished processing BAM request
2018-11-29 20:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669589   8 58451 75306037 A  ERROR'
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:55:06 [DEBUG   ] spawn_process: at 2018-11-29 20:55:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:55:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:55:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:55:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:55:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:55:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:55:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:55:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:55:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:55:13 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-29 20:55:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:55:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:55:49 [DEBUG   ] Got command RPT from MCS: ref #669590
2018-11-29 20:55:49 [DEBUG   ] summary = ERROR
2018-11-29 20:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669590  13 58451 75349797 A  ERRORERROR'
2018-11-29 20:55:49 [DEBUG   ] Got command RPT from MCS: ref #669591
2018-11-29 20:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669591  77 58451 75349798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:55:54 [DEBUG   ] Got command BAM from MCS: ref #669607
2018-11-29 20:55:54 [INFO    ] Finished processing BAM request
2018-11-29 20:55:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669607   8 58451 75354025 A  ERROR'
2018-11-29 20:55:54 [DEBUG   ] Got command BAM from MCS: ref #669608
2018-11-29 20:55:54 [INFO    ] Finished processing BAM request
2018-11-29 20:55:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669608   8 58451 75354029 A  ERROR'
2018-11-29 20:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 20:55:54 [DEBUG   ] spawn_process: at 2018-11-29 20:55:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 20:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 20:55:55 [DEBUG   ] spawn_process: at 2018-11-29 20:55:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 20:56:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-29 20:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 20:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:56:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:56:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:56:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:56:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:56:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:56:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:56:13 [DEBUG   ] Finished updating board flags in 1.066 seconds
2018-11-29 20:56:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:56:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:56:42 [DEBUG   ] Got command BAM from MCS: ref #669613
2018-11-29 20:56:42 [INFO    ] Finished processing BAM request
2018-11-29 20:56:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669613   8 58451 75402025 A  ERROR'
2018-11-29 20:56:42 [DEBUG   ] Got command BAM from MCS: ref #669614
2018-11-29 20:56:42 [INFO    ] Finished processing BAM request
2018-11-29 20:56:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669614   8 58451 75402029 A  ERROR'
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:56:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:56:42 [DEBUG   ] spawn_process: at 2018-11-29 20:56:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:57:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:57:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 20:57:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 20:57:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 20:57:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:57:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:57:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:57:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:57:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:57:13 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-11-29 20:57:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:57:30 [DEBUG   ] Got command BAM from MCS: ref #669615
2018-11-29 20:57:30 [INFO    ] Finished processing BAM request
2018-11-29 20:57:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669615   8 58451 75450029 A  ERROR'
2018-11-29 20:57:30 [DEBUG   ] Got command BAM from MCS: ref #669616
2018-11-29 20:57:30 [INFO    ] Finished processing BAM request
2018-11-29 20:57:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669616   8 58451 75450033 A  ERROR'
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 20:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 20:57:30 [DEBUG   ] spawn_process: at 2018-11-29 20:57:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 20:57:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:58:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:58:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:58:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:58:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:58:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:58:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:58:13 [DEBUG   ] Finished updating board flags in 1.325 seconds
2018-11-29 20:58:18 [DEBUG   ] Got command BAM from MCS: ref #669618
2018-11-29 20:58:18 [INFO    ] Finished processing BAM request
2018-11-29 20:58:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669618   8 58451 75498033 A  ERROR'
2018-11-29 20:58:18 [DEBUG   ] Got command BAM from MCS: ref #669617
2018-11-29 20:58:18 [INFO    ] Finished processing BAM request
2018-11-29 20:58:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669617   8 58451 75498037 A  ERROR'
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 20:58:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 20:58:18 [DEBUG   ] spawn_process: at 2018-11-29 20:58:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 20:58:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:58:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:59:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 20:59:01 [DEBUG   ] Got command RPT from MCS: ref #669619
2018-11-29 20:59:01 [DEBUG   ] summary = ERROR
2018-11-29 20:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669619  13 58451 75541753 A  ERRORERROR'
2018-11-29 20:59:01 [DEBUG   ] Got command RPT from MCS: ref #669620
2018-11-29 20:59:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669620  77 58451 75541957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:59:02 [DEBUG   ] Got command RPT from MCS: ref #669621
2018-11-29 20:59:02 [DEBUG   ] summary = ERROR
2018-11-29 20:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669621  13 58451 75542149 A  ERRORERROR'
2018-11-29 20:59:02 [DEBUG   ] Got command RPT from MCS: ref #669622
2018-11-29 20:59:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 20:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669622  77 58451 75542353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 20:59:02 [DEBUG   ] Got command RPT from MCS: ref #669623
2018-11-29 20:59:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 20:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669623  12 58451 75542557 A  ERRORB¡ff'
2018-11-29 20:59:06 [DEBUG   ] Got command BAM from MCS: ref #669624
2018-11-29 20:59:06 [INFO    ] Finished processing BAM request
2018-11-29 20:59:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669624   8 58451 75546029 A  ERROR'
2018-11-29 20:59:06 [DEBUG   ] Got command BAM from MCS: ref #669625
2018-11-29 20:59:06 [INFO    ] Finished processing BAM request
2018-11-29 20:59:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669625   8 58451 75546033 A  ERROR'
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 20:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 20:59:06 [DEBUG   ] spawn_process: at 2018-11-29 20:59:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 20:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 20:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 20:59:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 20:59:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:59:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:59:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:59:13 [WARNING ] (13, 1, 'bot')
2018-11-29 20:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 20:59:13 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-11-29 20:59:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:59:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 20:59:54 [DEBUG   ] Got command BAM from MCS: ref #669631
2018-11-29 20:59:54 [INFO    ] Finished processing BAM request
2018-11-29 20:59:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669631   8 58451 75594025 A  ERROR'
2018-11-29 20:59:54 [DEBUG   ] Got command BAM from MCS: ref #669630
2018-11-29 20:59:54 [INFO    ] Finished processing BAM request
2018-11-29 20:59:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 20:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669630   8 58451 75594029 A  ERROR'
2018-11-29 20:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 20:59:54 [DEBUG   ] spawn_process: at 2018-11-29 20:59:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 20:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 20:59:55 [DEBUG   ] spawn_process: at 2018-11-29 20:59:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:00:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 21:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:00:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:00:13 [WARNING ] (13, 1, 'bot')
2018-11-29 21:00:13 [WARNING ] (13, 1, 'bot')
2018-11-29 21:00:13 [WARNING ] (13, 1, 'bot')
2018-11-29 21:00:13 [WARNING ] (13, 1, 'bot')
2018-11-29 21:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:00:13 [DEBUG   ] Finished updating board flags in 1.159 seconds
2018-11-29 21:00:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:00:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:00:42 [DEBUG   ] Got command BAM from MCS: ref #669632
2018-11-29 21:00:42 [INFO    ] Finished processing BAM request
2018-11-29 21:00:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:00:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669632   8 58451 75642029 A  ERROR'
2018-11-29 21:00:42 [DEBUG   ] Got command BAM from MCS: ref #669633
2018-11-29 21:00:42 [INFO    ] Finished processing BAM request
2018-11-29 21:00:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:00:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669633   8 58451 75642033 A  ERROR'
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:00:42 [DEBUG   ] spawn_process: at 2018-11-29 21:00:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:00:49 [DEBUG   ] Got command RPT from MCS: ref #669634
2018-11-29 21:00:49 [DEBUG   ] summary = ERROR
2018-11-29 21:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669634  13 58451 75649801 A  ERRORERROR'
2018-11-29 21:00:49 [DEBUG   ] Got command RPT from MCS: ref #669635
2018-11-29 21:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669635  77 58451 75649802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:01:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 21:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:01:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:01:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:01:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:01:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:01:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:01:14 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-11-29 21:01:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 21:01:29 [DEBUG   ] Got command BAM from MCS: ref #669651
2018-11-29 21:01:29 [INFO    ] Finished processing BAM request
2018-11-29 21:01:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669651   8 58451 75689033 A  ERROR'
2018-11-29 21:01:29 [DEBUG   ] Got command BAM from MCS: ref #669652
2018-11-29 21:01:29 [INFO    ] Finished processing BAM request
2018-11-29 21:01:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669652   8 58451 75689037 A  ERROR'
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:01:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:01:29 [DEBUG   ] spawn_process: at 2018-11-29 21:01:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:01:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:02:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 21:02:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:02:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:02:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:02:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:02:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:02:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:02:14 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-29 21:02:16 [DEBUG   ] Got command BAM from MCS: ref #669657
2018-11-29 21:02:16 [INFO    ] Finished processing BAM request
2018-11-29 21:02:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669657   8 58451 75736029 A  ERROR'
2018-11-29 21:02:16 [DEBUG   ] Got command BAM from MCS: ref #669658
2018-11-29 21:02:16 [INFO    ] Finished processing BAM request
2018-11-29 21:02:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:02:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669658   8 58451 75736033 A  ERROR'
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:02:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:02:16 [DEBUG   ] spawn_process: at 2018-11-29 21:02:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:02:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:02:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:03:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:03:03 [DEBUG   ] Got command BAM from MCS: ref #669659
2018-11-29 21:03:03 [INFO    ] Finished processing BAM request
2018-11-29 21:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669659   8 58451 75783033 A  ERROR'
2018-11-29 21:03:03 [DEBUG   ] Got command BAM from MCS: ref #669660
2018-11-29 21:03:03 [INFO    ] Finished processing BAM request
2018-11-29 21:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669660   8 58451 75783037 A  ERROR'
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:03:03 [DEBUG   ] spawn_process: at 2018-11-29 21:03:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 21:03:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:03:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:03:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:03:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:03:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:03:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:03:14 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-29 21:03:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:03:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:03:50 [DEBUG   ] Got command BAM from MCS: ref #669664
2018-11-29 21:03:50 [INFO    ] Finished processing BAM request
2018-11-29 21:03:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669664   8 58451 75830025 A  ERROR'
2018-11-29 21:03:50 [DEBUG   ] Got command BAM from MCS: ref #669663
2018-11-29 21:03:50 [INFO    ] Finished processing BAM request
2018-11-29 21:03:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669663   8 58451 75830029 A  ERROR'
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:03:50 [DEBUG   ] spawn_process: at 2018-11-29 21:03:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:04:01 [DEBUG   ] Got command RPT from MCS: ref #669665
2018-11-29 21:04:01 [DEBUG   ] summary = ERROR
2018-11-29 21:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669665  13 58451 75841841 A  ERRORERROR'
2018-11-29 21:04:02 [DEBUG   ] Got command RPT from MCS: ref #669666
2018-11-29 21:04:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669666  77 58451 75842033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:04:02 [DEBUG   ] Got command RPT from MCS: ref #669667
2018-11-29 21:04:02 [DEBUG   ] summary = ERROR
2018-11-29 21:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669667  13 58451 75842237 A  ERRORERROR'
2018-11-29 21:04:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:04:02 [DEBUG   ] Got command RPT from MCS: ref #669669
2018-11-29 21:04:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669669  77 58451 75842441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:04:02 [DEBUG   ] Got command RPT from MCS: ref #669670
2018-11-29 21:04:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669670  12 58451 75842645 A  ERRORB£ff'
2018-11-29 21:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:04:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:04:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:04:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:04:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:04:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:04:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:04:14 [DEBUG   ] Finished updating board flags in 1.246 seconds
2018-11-29 21:04:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:04:37 [DEBUG   ] Got command BAM from MCS: ref #669676
2018-11-29 21:04:37 [INFO    ] Finished processing BAM request
2018-11-29 21:04:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669676   8 58451 75877029 A  ERROR'
2018-11-29 21:04:37 [DEBUG   ] Got command BAM from MCS: ref #669675
2018-11-29 21:04:37 [INFO    ] Finished processing BAM request
2018-11-29 21:04:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669675   8 58451 75877033 A  ERROR'
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:04:37 [DEBUG   ] spawn_process: at 2018-11-29 21:04:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:04:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:05:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 21:05:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:05:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:05:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:05:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:05:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:05:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:05:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:05:14 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-29 21:05:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:05:24 [DEBUG   ] Got command BAM from MCS: ref #669682
2018-11-29 21:05:24 [INFO    ] Finished processing BAM request
2018-11-29 21:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669682   8 58451 75924025 A  ERROR'
2018-11-29 21:05:24 [DEBUG   ] Got command BAM from MCS: ref #669681
2018-11-29 21:05:24 [INFO    ] Finished processing BAM request
2018-11-29 21:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669681   8 58451 75924029 A  ERROR'
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:05:24 [DEBUG   ] spawn_process: at 2018-11-29 21:05:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:05:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:05:49 [DEBUG   ] Got command RPT from MCS: ref #669683
2018-11-29 21:05:49 [DEBUG   ] summary = ERROR
2018-11-29 21:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669683  13 58451 75949954 A  ERRORERROR'
2018-11-29 21:05:49 [DEBUG   ] Got command RPT from MCS: ref #669684
2018-11-29 21:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669684  77 58451 75949955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:06:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:06:11 [DEBUG   ] Got command BAM from MCS: ref #669701
2018-11-29 21:06:11 [INFO    ] Finished processing BAM request
2018-11-29 21:06:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669701   8 58451 75971030 A  ERROR'
2018-11-29 21:06:11 [DEBUG   ] Got command BAM from MCS: ref #669700
2018-11-29 21:06:11 [INFO    ] Finished processing BAM request
2018-11-29 21:06:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669700   8 58451 75971034 A  ERROR'
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:06:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:06:11 [DEBUG   ] spawn_process: at 2018-11-29 21:06:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:06:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:06:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:06:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:06:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:06:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:06:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:06:14 [DEBUG   ] Finished updating board flags in 1.119 seconds
2018-11-29 21:06:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:06:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 21:06:58 [DEBUG   ] Got command BAM from MCS: ref #669702
2018-11-29 21:06:58 [INFO    ] Finished processing BAM request
2018-11-29 21:06:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669702   8 58451 76018029 A  ERROR'
2018-11-29 21:06:58 [DEBUG   ] Got command BAM from MCS: ref #669703
2018-11-29 21:06:58 [INFO    ] Finished processing BAM request
2018-11-29 21:06:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669703   8 58451 76018033 A  ERROR'
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:06:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:06:58 [DEBUG   ] spawn_process: at 2018-11-29 21:06:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:07:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 21:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:07:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:07:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:07:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:07:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:07:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:07:14 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-29 21:07:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:07:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:07:45 [DEBUG   ] Got command BAM from MCS: ref #669704
2018-11-29 21:07:45 [INFO    ] Finished processing BAM request
2018-11-29 21:07:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:07:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669704   8 58451 76065030 A  ERROR'
2018-11-29 21:07:45 [DEBUG   ] Got command BAM from MCS: ref #669705
2018-11-29 21:07:45 [INFO    ] Finished processing BAM request
2018-11-29 21:07:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:07:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669705   8 58451 76065034 A  ERROR'
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:07:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:07:45 [DEBUG   ] spawn_process: at 2018-11-29 21:07:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:08:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:08:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:08:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:08:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:08:15 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-29 21:08:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 21:08:32 [DEBUG   ] Got command BAM from MCS: ref #669710
2018-11-29 21:08:32 [INFO    ] Finished processing BAM request
2018-11-29 21:08:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669710   8 58451 76112025 A  ERROR'
2018-11-29 21:08:32 [DEBUG   ] Got command BAM from MCS: ref #669711
2018-11-29 21:08:32 [INFO    ] Finished processing BAM request
2018-11-29 21:08:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669711   8 58451 76112029 A  ERROR'
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:08:32 [DEBUG   ] spawn_process: at 2018-11-29 21:08:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:08:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:09:01 [DEBUG   ] Got command RPT from MCS: ref #669712
2018-11-29 21:09:01 [DEBUG   ] summary = ERROR
2018-11-29 21:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669712  13 58451 76141921 A  ERRORERROR'
2018-11-29 21:09:02 [DEBUG   ] Got command RPT from MCS: ref #669713
2018-11-29 21:09:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:09:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669713  77 58451 76142125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:09:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:09:02 [DEBUG   ] Got command RPT from MCS: ref #669714
2018-11-29 21:09:02 [DEBUG   ] summary = ERROR
2018-11-29 21:09:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669714  13 58451 76142329 A  ERRORERROR'
2018-11-29 21:09:02 [DEBUG   ] Got command RPT from MCS: ref #669715
2018-11-29 21:09:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:09:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669715  77 58451 76142521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:09:02 [DEBUG   ] Got command RPT from MCS: ref #669716
2018-11-29 21:09:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:09:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669716  12 58451 76142725 A  ERRORB¢ff'
2018-11-29 21:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 21:09:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:09:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:09:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:09:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:09:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:09:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:09:14 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-29 21:09:19 [DEBUG   ] Got command BAM from MCS: ref #669717
2018-11-29 21:09:19 [INFO    ] Finished processing BAM request
2018-11-29 21:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669717   8 58451 76159025 A  ERROR'
2018-11-29 21:09:19 [DEBUG   ] Got command BAM from MCS: ref #669718
2018-11-29 21:09:19 [INFO    ] Finished processing BAM request
2018-11-29 21:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669718   8 58451 76159029 A  ERROR'
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:09:19 [DEBUG   ] spawn_process: at 2018-11-29 21:09:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:09:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:09:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:10:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:10:06 [DEBUG   ] Got command BAM from MCS: ref #669719
2018-11-29 21:10:06 [INFO    ] Finished processing BAM request
2018-11-29 21:10:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669719   8 58451 76206029 A  ERROR'
2018-11-29 21:10:06 [DEBUG   ] Got command BAM from MCS: ref #669720
2018-11-29 21:10:06 [INFO    ] Finished processing BAM request
2018-11-29 21:10:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669720   8 58451 76206033 A  ERROR'
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:10:06 [DEBUG   ] spawn_process: at 2018-11-29 21:10:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 21:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 21:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:10:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:10:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:10:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:10:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:10:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:10:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:10:14 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-29 21:10:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:10:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:10:49 [DEBUG   ] Got command RPT from MCS: ref #669721
2018-11-29 21:10:49 [DEBUG   ] summary = ERROR
2018-11-29 21:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669721  13 58451 76249805 A  ERRORERROR'
2018-11-29 21:10:49 [DEBUG   ] Got command RPT from MCS: ref #669722
2018-11-29 21:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669722  77 58451 76249806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:10:53 [DEBUG   ] Got command BAM from MCS: ref #669739
2018-11-29 21:10:53 [INFO    ] Finished processing BAM request
2018-11-29 21:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669739   8 58451 76253025 A  ERROR'
2018-11-29 21:10:53 [DEBUG   ] Got command BAM from MCS: ref #669738
2018-11-29 21:10:53 [INFO    ] Finished processing BAM request
2018-11-29 21:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669738   8 58451 76253029 A  ERROR'
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:10:53 [DEBUG   ] spawn_process: at 2018-11-29 21:10:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:11:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:11:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:11:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:11:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:11:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:11:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:11:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:11:14 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-11-29 21:11:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:11:40 [DEBUG   ] Got command BAM from MCS: ref #669744
2018-11-29 21:11:40 [INFO    ] Finished processing BAM request
2018-11-29 21:11:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669744   8 58451 76300029 A  ERROR'
2018-11-29 21:11:40 [DEBUG   ] Got command BAM from MCS: ref #669745
2018-11-29 21:11:40 [INFO    ] Finished processing BAM request
2018-11-29 21:11:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669745   8 58451 76300033 A  ERROR'
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:11:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:11:40 [DEBUG   ] spawn_process: at 2018-11-29 21:11:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:11:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:12:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-29 21:12:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:12:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:12:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:12:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:12:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:12:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:12:14 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-29 21:12:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:12:27 [DEBUG   ] Got command BAM from MCS: ref #669746
2018-11-29 21:12:27 [INFO    ] Finished processing BAM request
2018-11-29 21:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669746   8 58451 76347029 A  ERROR'
2018-11-29 21:12:27 [DEBUG   ] Got command BAM from MCS: ref #669747
2018-11-29 21:12:27 [INFO    ] Finished processing BAM request
2018-11-29 21:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669747   8 58451 76347033 A  ERROR'
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:12:27 [DEBUG   ] spawn_process: at 2018-11-29 21:12:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:12:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:13:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:13:14 [DEBUG   ] Got command BAM from MCS: ref #669749
2018-11-29 21:13:14 [INFO    ] Finished processing BAM request
2018-11-29 21:13:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669749   8 58451 76394025 A  ERROR'
2018-11-29 21:13:14 [DEBUG   ] Got command BAM from MCS: ref #669748
2018-11-29 21:13:14 [INFO    ] Finished processing BAM request
2018-11-29 21:13:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669748   8 58451 76394029 A  ERROR'
2018-11-29 21:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:13:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:13:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:13:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:13:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:13:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:13:14 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:13:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:13:14 [DEBUG   ] spawn_process: at 2018-11-29 21:13:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:13:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:13:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:14:01 [DEBUG   ] Got command BAM from MCS: ref #669753
2018-11-29 21:14:01 [INFO    ] Finished processing BAM request
2018-11-29 21:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669753   8 58451 76441029 A  ERROR'
2018-11-29 21:14:01 [DEBUG   ] Got command BAM from MCS: ref #669752
2018-11-29 21:14:01 [INFO    ] Finished processing BAM request
2018-11-29 21:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669752   8 58451 76441033 A  ERROR'
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:14:01 [DEBUG   ] spawn_process: at 2018-11-29 21:14:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:14:02 [DEBUG   ] Got command RPT from MCS: ref #669754
2018-11-29 21:14:02 [DEBUG   ] summary = ERROR
2018-11-29 21:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669754  13 58451 76442005 A  ERRORERROR'
2018-11-29 21:14:02 [DEBUG   ] Got command RPT from MCS: ref #669755
2018-11-29 21:14:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669755  77 58451 76442209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:14:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:14:02 [DEBUG   ] Got command RPT from MCS: ref #669756
2018-11-29 21:14:02 [DEBUG   ] summary = ERROR
2018-11-29 21:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669756  13 58451 76442405 A  ERRORERROR'
2018-11-29 21:14:02 [DEBUG   ] Got command RPT from MCS: ref #669758
2018-11-29 21:14:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669758  77 58451 76442609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:14:02 [DEBUG   ] Got command RPT from MCS: ref #669759
2018-11-29 21:14:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669759  12 58451 76442813 A  ERRORB£ff'
2018-11-29 21:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:14:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:14:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:14:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:14:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:14:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:14:14 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-29 21:14:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 21:14:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:14:48 [DEBUG   ] Got command BAM from MCS: ref #669769
2018-11-29 21:14:48 [INFO    ] Finished processing BAM request
2018-11-29 21:14:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669769   8 58451 76488033 A  ERROR'
2018-11-29 21:14:48 [DEBUG   ] Got command BAM from MCS: ref #669768
2018-11-29 21:14:48 [INFO    ] Finished processing BAM request
2018-11-29 21:14:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669768   8 58451 76488037 A  ERROR'
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:14:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:14:48 [DEBUG   ] spawn_process: at 2018-11-29 21:14:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:15:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:15:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:15:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:15:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:15:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:15:14 [WARNING ] (13, 1, 'bot')
2018-11-29 21:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:15:14 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-29 21:15:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:15:35 [DEBUG   ] Got command BAM from MCS: ref #669771
2018-11-29 21:15:35 [INFO    ] Finished processing BAM request
2018-11-29 21:15:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669771   8 58451 76535025 A  ERROR'
2018-11-29 21:15:35 [DEBUG   ] Got command BAM from MCS: ref #669770
2018-11-29 21:15:35 [INFO    ] Finished processing BAM request
2018-11-29 21:15:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669770   8 58451 76535029 A  ERROR'
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:15:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:15:35 [DEBUG   ] spawn_process: at 2018-11-29 21:15:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:15:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:15:49 [DEBUG   ] Got command RPT from MCS: ref #669772
2018-11-29 21:15:49 [DEBUG   ] summary = ERROR
2018-11-29 21:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669772  13 58451 76549801 A  ERRORERROR'
2018-11-29 21:15:49 [DEBUG   ] Got command RPT from MCS: ref #669773
2018-11-29 21:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669773  77 58451 76549802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:16:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 21:16:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:16:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:16:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:16:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:16:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:16:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:16:15 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-11-29 21:16:22 [DEBUG   ] Got command BAM from MCS: ref #669790
2018-11-29 21:16:22 [INFO    ] Finished processing BAM request
2018-11-29 21:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669790   8 58451 76582033 A  ERROR'
2018-11-29 21:16:22 [DEBUG   ] Got command BAM from MCS: ref #669789
2018-11-29 21:16:22 [INFO    ] Finished processing BAM request
2018-11-29 21:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669789   8 58451 76582037 A  ERROR'
2018-11-29 21:16:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:16:22 [DEBUG   ] spawn_process: at 2018-11-29 21:16:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:16:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:17:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:17:09 [DEBUG   ] Got command BAM from MCS: ref #669792
2018-11-29 21:17:09 [INFO    ] Finished processing BAM request
2018-11-29 21:17:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669792   8 58451 76629025 A  ERROR'
2018-11-29 21:17:09 [DEBUG   ] Got command BAM from MCS: ref #669791
2018-11-29 21:17:09 [INFO    ] Finished processing BAM request
2018-11-29 21:17:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:17:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669791   8 58451 76629029 A  ERROR'
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:17:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:17:09 [DEBUG   ] spawn_process: at 2018-11-29 21:17:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:17:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:17:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:17:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:17:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:17:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:17:15 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-29 21:17:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:17:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:17:56 [DEBUG   ] Got command BAM from MCS: ref #669798
2018-11-29 21:17:56 [INFO    ] Finished processing BAM request
2018-11-29 21:17:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:17:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669798   8 58451 76676029 A  ERROR'
2018-11-29 21:17:56 [DEBUG   ] Got command BAM from MCS: ref #669797
2018-11-29 21:17:56 [INFO    ] Finished processing BAM request
2018-11-29 21:17:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:17:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669797   8 58451 76676033 A  ERROR'
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:17:56 [DEBUG   ] spawn_process: at 2018-11-29 21:17:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:18:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:18:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:18:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:18:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:18:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:18:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:18:15 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-29 21:18:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:18:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:18:43 [DEBUG   ] Got command BAM from MCS: ref #669800
2018-11-29 21:18:43 [INFO    ] Finished processing BAM request
2018-11-29 21:18:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669800   8 58451 76723029 A  ERROR'
2018-11-29 21:18:43 [DEBUG   ] Got command BAM from MCS: ref #669799
2018-11-29 21:18:43 [INFO    ] Finished processing BAM request
2018-11-29 21:18:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669799   8 58451 76723033 A  ERROR'
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:18:43 [DEBUG   ] spawn_process: at 2018-11-29 21:18:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:19:02 [DEBUG   ] Got command RPT from MCS: ref #669801
2018-11-29 21:19:02 [DEBUG   ] summary = ERROR
2018-11-29 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669801  13 58451 76742097 A  ERRORERROR'
2018-11-29 21:19:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:19:02 [DEBUG   ] Got command RPT from MCS: ref #669802
2018-11-29 21:19:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669802  77 58451 76742293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:19:02 [DEBUG   ] Got command RPT from MCS: ref #669803
2018-11-29 21:19:02 [DEBUG   ] summary = ERROR
2018-11-29 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669803  13 58451 76742497 A  ERRORERROR'
2018-11-29 21:19:02 [DEBUG   ] Got command RPT from MCS: ref #669804
2018-11-29 21:19:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669804  77 58451 76742701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:19:02 [DEBUG   ] Got command RPT from MCS: ref #669805
2018-11-29 21:19:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669805  12 58451 76742893 A  ERRORB¢ff'
2018-11-29 21:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:19:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:19:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:19:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:19:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:19:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:19:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:19:15 [DEBUG   ] Finished updating board flags in 1.258 seconds
2018-11-29 21:19:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:19:30 [DEBUG   ] Got command BAM from MCS: ref #669806
2018-11-29 21:19:30 [INFO    ] Finished processing BAM request
2018-11-29 21:19:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669806   8 58451 76770033 A  ERROR'
2018-11-29 21:19:30 [DEBUG   ] Got command BAM from MCS: ref #669807
2018-11-29 21:19:30 [INFO    ] Finished processing BAM request
2018-11-29 21:19:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669807   8 58451 76770037 A  ERROR'
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:19:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:19:30 [DEBUG   ] spawn_process: at 2018-11-29 21:19:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:19:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:20:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 21:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 21:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:20:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:20:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:20:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:20:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:20:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:20:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:20:15 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-29 21:20:17 [DEBUG   ] Got command BAM from MCS: ref #669812
2018-11-29 21:20:17 [INFO    ] Finished processing BAM request
2018-11-29 21:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669812   8 58451 76817025 A  ERROR'
2018-11-29 21:20:17 [DEBUG   ] Got command BAM from MCS: ref #669813
2018-11-29 21:20:17 [INFO    ] Finished processing BAM request
2018-11-29 21:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669813   8 58451 76817029 A  ERROR'
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:20:17 [DEBUG   ] spawn_process: at 2018-11-29 21:20:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:20:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:20:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:20:49 [DEBUG   ] Got command RPT from MCS: ref #669814
2018-11-29 21:20:49 [DEBUG   ] summary = ERROR
2018-11-29 21:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669814  13 58451 76849809 A  ERRORERROR'
2018-11-29 21:20:49 [DEBUG   ] Got command RPT from MCS: ref #669815
2018-11-29 21:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669815  77 58451 76849810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:21:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 21:21:04 [DEBUG   ] Got command BAM from MCS: ref #669832
2018-11-29 21:21:04 [INFO    ] Finished processing BAM request
2018-11-29 21:21:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669832   8 58451 76864025 A  ERROR'
2018-11-29 21:21:04 [DEBUG   ] Got command BAM from MCS: ref #669831
2018-11-29 21:21:04 [INFO    ] Finished processing BAM request
2018-11-29 21:21:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669831   8 58451 76864029 A  ERROR'
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:21:04 [DEBUG   ] spawn_process: at 2018-11-29 21:21:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:21:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:21:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:21:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:21:16 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-11-29 21:21:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 21:21:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:21:51 [DEBUG   ] Got command BAM from MCS: ref #669833
2018-11-29 21:21:51 [INFO    ] Finished processing BAM request
2018-11-29 21:21:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669833   8 58451 76911029 A  ERROR'
2018-11-29 21:21:51 [DEBUG   ] Got command BAM from MCS: ref #669834
2018-11-29 21:21:51 [INFO    ] Finished processing BAM request
2018-11-29 21:21:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669834   8 58451 76911033 A  ERROR'
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:21:51 [DEBUG   ] spawn_process: at 2018-11-29 21:21:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:22:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:22:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:22:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:22:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:22:16 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-29 21:22:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 21:22:38 [DEBUG   ] Got command BAM from MCS: ref #669836
2018-11-29 21:22:38 [INFO    ] Finished processing BAM request
2018-11-29 21:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669836   8 58451 76958025 A  ERROR'
2018-11-29 21:22:38 [DEBUG   ] Got command BAM from MCS: ref #669835
2018-11-29 21:22:38 [INFO    ] Finished processing BAM request
2018-11-29 21:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669835   8 58451 76958029 A  ERROR'
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:22:38 [DEBUG   ] spawn_process: at 2018-11-29 21:22:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:22:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 21:23:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:23:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:23:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:23:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:23:16 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-29 21:23:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:23:25 [DEBUG   ] Got command BAM from MCS: ref #669842
2018-11-29 21:23:25 [INFO    ] Finished processing BAM request
2018-11-29 21:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669842   8 58451 77005033 A  ERROR'
2018-11-29 21:23:25 [DEBUG   ] Got command BAM from MCS: ref #669841
2018-11-29 21:23:25 [INFO    ] Finished processing BAM request
2018-11-29 21:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669841   8 58451 77005037 A  ERROR'
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:23:25 [DEBUG   ] spawn_process: at 2018-11-29 21:23:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:23:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:24:02 [DEBUG   ] Got command RPT from MCS: ref #669845
2018-11-29 21:24:02 [DEBUG   ] summary = ERROR
2018-11-29 21:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669845  13 58451 77042181 A  ERRORERROR'
2018-11-29 21:24:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:24:02 [DEBUG   ] Got command RPT from MCS: ref #669846
2018-11-29 21:24:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669846  77 58451 77042385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:24:02 [DEBUG   ] Got command RPT from MCS: ref #669847
2018-11-29 21:24:02 [DEBUG   ] summary = ERROR
2018-11-29 21:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669847  13 58451 77042577 A  ERRORERROR'
2018-11-29 21:24:02 [DEBUG   ] Got command RPT from MCS: ref #669849
2018-11-29 21:24:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669849  77 58451 77042781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:24:02 [DEBUG   ] Got command RPT from MCS: ref #669850
2018-11-29 21:24:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669850  12 58451 77042985 A  ERRORB£ff'
2018-11-29 21:24:12 [DEBUG   ] Got command BAM from MCS: ref #669855
2018-11-29 21:24:12 [INFO    ] Finished processing BAM request
2018-11-29 21:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669855   8 58451 77052025 A  ERROR'
2018-11-29 21:24:12 [DEBUG   ] Got command BAM from MCS: ref #669856
2018-11-29 21:24:12 [INFO    ] Finished processing BAM request
2018-11-29 21:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669856   8 58451 77052029 A  ERROR'
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:24:12 [DEBUG   ] spawn_process: at 2018-11-29 21:24:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-29 21:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 21:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 21:24:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:24:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:24:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:24:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:24:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:24:15 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-29 21:24:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:24:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:24:59 [DEBUG   ] Got command BAM from MCS: ref #669857
2018-11-29 21:24:59 [INFO    ] Finished processing BAM request
2018-11-29 21:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669857   8 58451 77099033 A  ERROR'
2018-11-29 21:24:59 [DEBUG   ] Got command BAM from MCS: ref #669858
2018-11-29 21:24:59 [INFO    ] Finished processing BAM request
2018-11-29 21:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669858   8 58451 77099037 A  ERROR'
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:24:59 [DEBUG   ] spawn_process: at 2018-11-29 21:24:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:25:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:25:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 21:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-29 21:25:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:25:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:25:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:25:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:25:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:25:15 [DEBUG   ] Finished updating board flags in 1.286 seconds
2018-11-29 21:25:22 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 21:25:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:25:46 [DEBUG   ] Got command BAM from MCS: ref #669859
2018-11-29 21:25:46 [INFO    ] Finished processing BAM request
2018-11-29 21:25:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:25:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669859   8 58451 77146033 A  ERROR'
2018-11-29 21:25:46 [DEBUG   ] Got command BAM from MCS: ref #669860
2018-11-29 21:25:46 [INFO    ] Finished processing BAM request
2018-11-29 21:25:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:25:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669860   8 58451 77146037 A  ERROR'
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:25:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:25:46 [DEBUG   ] spawn_process: at 2018-11-29 21:25:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:25:49 [DEBUG   ] Got command RPT from MCS: ref #669861
2018-11-29 21:25:49 [DEBUG   ] summary = ERROR
2018-11-29 21:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669861  13 58451 77149805 A  ERRORERROR'
2018-11-29 21:25:49 [DEBUG   ] Got command RPT from MCS: ref #669862
2018-11-29 21:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669862  77 58451 77149806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:26:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-29 21:26:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 21:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 21:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:26:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:26:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:26:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:26:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:26:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:26:15 [DEBUG   ] Finished updating board flags in 1.151 seconds
2018-11-29 21:26:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:26:33 [DEBUG   ] Got command BAM from MCS: ref #669882
2018-11-29 21:26:33 [INFO    ] Finished processing BAM request
2018-11-29 21:26:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669882   8 58451 77193025 A  ERROR'
2018-11-29 21:26:33 [DEBUG   ] Got command BAM from MCS: ref #669883
2018-11-29 21:26:33 [INFO    ] Finished processing BAM request
2018-11-29 21:26:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669883   8 58451 77193029 A  ERROR'
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:26:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:26:33 [DEBUG   ] spawn_process: at 2018-11-29 21:26:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:26:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:27:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 21:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:27:15 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:27:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:27:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:27:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:27:15 [WARNING ] (13, 1, 'bot')
2018-11-29 21:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:27:15 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-29 21:27:20 [DEBUG   ] Got command BAM from MCS: ref #669885
2018-11-29 21:27:20 [INFO    ] Finished processing BAM request
2018-11-29 21:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669885   8 58451 77240025 A  ERROR'
2018-11-29 21:27:20 [DEBUG   ] Got command BAM from MCS: ref #669884
2018-11-29 21:27:20 [INFO    ] Finished processing BAM request
2018-11-29 21:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669884   8 58451 77240029 A  ERROR'
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:27:20 [DEBUG   ] spawn_process: at 2018-11-29 21:27:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:27:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:27:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:28:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:28:07 [DEBUG   ] Got command BAM from MCS: ref #669886
2018-11-29 21:28:07 [INFO    ] Finished processing BAM request
2018-11-29 21:28:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:28:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669886   8 58451 77287025 A  ERROR'
2018-11-29 21:28:07 [DEBUG   ] Got command BAM from MCS: ref #669887
2018-11-29 21:28:07 [INFO    ] Finished processing BAM request
2018-11-29 21:28:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:28:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669887   8 58451 77287029 A  ERROR'
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:28:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:28:07 [DEBUG   ] spawn_process: at 2018-11-29 21:28:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:28:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:28:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:28:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:28:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:28:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:28:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:28:16 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-11-29 21:28:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:28:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:28:54 [DEBUG   ] Got command BAM from MCS: ref #669888
2018-11-29 21:28:54 [INFO    ] Finished processing BAM request
2018-11-29 21:28:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669888   8 58451 77334025 A  ERROR'
2018-11-29 21:28:54 [DEBUG   ] Got command BAM from MCS: ref #669889
2018-11-29 21:28:54 [INFO    ] Finished processing BAM request
2018-11-29 21:28:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669889   8 58451 77334029 A  ERROR'
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:28:54 [DEBUG   ] spawn_process: at 2018-11-29 21:28:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:29:02 [DEBUG   ] Got command RPT from MCS: ref #669890
2018-11-29 21:29:02 [DEBUG   ] summary = ERROR
2018-11-29 21:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669890  13 58451 77342261 A  ERRORERROR'
2018-11-29 21:29:02 [DEBUG   ] Got command RPT from MCS: ref #669891
2018-11-29 21:29:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669891  77 58451 77342465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:29:02 [DEBUG   ] Got command RPT from MCS: ref #669892
2018-11-29 21:29:02 [DEBUG   ] summary = ERROR
2018-11-29 21:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669892  13 58451 77342669 A  ERRORERROR'
2018-11-29 21:29:02 [DEBUG   ] Got command RPT from MCS: ref #669893
2018-11-29 21:29:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669893  77 58451 77342861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:29:03 [DEBUG   ] Got command RPT from MCS: ref #669894
2018-11-29 21:29:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669894  12 58451 77343065 A  ERRORB¡ff'
2018-11-29 21:29:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-29 21:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:29:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:29:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:29:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:29:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:29:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:29:16 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-11-29 21:29:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:29:41 [DEBUG   ] Got command BAM from MCS: ref #669899
2018-11-29 21:29:41 [INFO    ] Finished processing BAM request
2018-11-29 21:29:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669899   8 58451 77381033 A  ERROR'
2018-11-29 21:29:41 [DEBUG   ] Got command BAM from MCS: ref #669900
2018-11-29 21:29:41 [INFO    ] Finished processing BAM request
2018-11-29 21:29:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669900   8 58451 77381037 A  ERROR'
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:29:41 [DEBUG   ] spawn_process: at 2018-11-29 21:29:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:29:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 21:30:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 21:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:30:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:30:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:30:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:30:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:30:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:30:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:30:16 [DEBUG   ] Finished updating board flags in 1.233 seconds
2018-11-29 21:30:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 21:30:28 [DEBUG   ] Got command BAM from MCS: ref #669902
2018-11-29 21:30:28 [INFO    ] Finished processing BAM request
2018-11-29 21:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669902   8 58451 77428029 A  ERROR'
2018-11-29 21:30:28 [DEBUG   ] Got command BAM from MCS: ref #669901
2018-11-29 21:30:28 [INFO    ] Finished processing BAM request
2018-11-29 21:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669901   8 58451 77428033 A  ERROR'
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:30:28 [DEBUG   ] spawn_process: at 2018-11-29 21:30:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:30:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:30:49 [DEBUG   ] Got command RPT from MCS: ref #669903
2018-11-29 21:30:49 [DEBUG   ] summary = ERROR
2018-11-29 21:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669903  13 58451 77449801 A  ERRORERROR'
2018-11-29 21:30:49 [DEBUG   ] Got command RPT from MCS: ref #669904
2018-11-29 21:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669904  77 58451 77449802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:31:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:31:15 [DEBUG   ] Got command BAM from MCS: ref #669920
2018-11-29 21:31:15 [INFO    ] Finished processing BAM request
2018-11-29 21:31:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669920   8 58451 77475025 A  ERROR'
2018-11-29 21:31:15 [DEBUG   ] Got command BAM from MCS: ref #669921
2018-11-29 21:31:15 [INFO    ] Finished processing BAM request
2018-11-29 21:31:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669921   8 58451 77475029 A  ERROR'
2018-11-29 21:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:31:15 [DEBUG   ] spawn_process: at 2018-11-29 21:31:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:31:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:31:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:31:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:31:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:31:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:31:16 [DEBUG   ] Finished updating board flags in 1.148 seconds
2018-11-29 21:31:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:31:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:32:02 [DEBUG   ] Got command BAM from MCS: ref #669922
2018-11-29 21:32:02 [INFO    ] Finished processing BAM request
2018-11-29 21:32:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669922   8 58451 77522033 A  ERROR'
2018-11-29 21:32:02 [DEBUG   ] Got command BAM from MCS: ref #669923
2018-11-29 21:32:02 [INFO    ] Finished processing BAM request
2018-11-29 21:32:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669923   8 58451 77522037 A  ERROR'
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:32:02 [DEBUG   ] spawn_process: at 2018-11-29 21:32:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:32:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:32:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:32:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:32:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:32:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:32:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:32:16 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-29 21:32:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:32:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:32:49 [DEBUG   ] Got command BAM from MCS: ref #669929
2018-11-29 21:32:49 [INFO    ] Finished processing BAM request
2018-11-29 21:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669929   8 58451 77569029 A  ERROR'
2018-11-29 21:32:49 [DEBUG   ] Got command BAM from MCS: ref #669928
2018-11-29 21:32:49 [INFO    ] Finished processing BAM request
2018-11-29 21:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669928   8 58451 77569033 A  ERROR'
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:32:49 [DEBUG   ] spawn_process: at 2018-11-29 21:32:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:33:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:33:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:33:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:33:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:33:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:33:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:33:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:33:16 [DEBUG   ] Finished updating board flags in 1.073 seconds
2018-11-29 21:33:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:33:36 [DEBUG   ] Got command BAM from MCS: ref #669930
2018-11-29 21:33:36 [INFO    ] Finished processing BAM request
2018-11-29 21:33:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669930   8 58451 77616033 A  ERROR'
2018-11-29 21:33:36 [DEBUG   ] Got command BAM from MCS: ref #669931
2018-11-29 21:33:36 [INFO    ] Finished processing BAM request
2018-11-29 21:33:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669931   8 58451 77616037 A  ERROR'
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:33:36 [DEBUG   ] spawn_process: at 2018-11-29 21:33:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:33:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:34:02 [DEBUG   ] Got command RPT from MCS: ref #669934
2018-11-29 21:34:02 [DEBUG   ] summary = ERROR
2018-11-29 21:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669934  13 58451 77642353 A  ERRORERROR'
2018-11-29 21:34:02 [DEBUG   ] Got command RPT from MCS: ref #669935
2018-11-29 21:34:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669935  77 58451 77642553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:34:02 [DEBUG   ] Got command RPT from MCS: ref #669936
2018-11-29 21:34:02 [DEBUG   ] summary = ERROR
2018-11-29 21:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669936  13 58451 77642745 A  ERRORERROR'
2018-11-29 21:34:02 [DEBUG   ] Got command RPT from MCS: ref #669938
2018-11-29 21:34:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669938  77 58451 77642949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:34:03 [DEBUG   ] Got command RPT from MCS: ref #669939
2018-11-29 21:34:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:34:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669939  12 58451 77643153 A  ERRORB¤ff'
2018-11-29 21:34:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2018-11-29 21:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 21:34:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 21:34:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:34:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 21:34:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:34:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:34:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:34:17 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-11-29 21:34:23 [DEBUG   ] Got command BAM from MCS: ref #669944
2018-11-29 21:34:23 [INFO    ] Finished processing BAM request
2018-11-29 21:34:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669944   8 58451 77663025 A  ERROR'
2018-11-29 21:34:23 [DEBUG   ] Got command BAM from MCS: ref #669945
2018-11-29 21:34:23 [INFO    ] Finished processing BAM request
2018-11-29 21:34:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669945   8 58451 77663029 A  ERROR'
2018-11-29 21:34:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:34:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:34:23 [DEBUG   ] spawn_process: at 2018-11-29 21:34:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:34:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:35:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:35:10 [DEBUG   ] Got command BAM from MCS: ref #669947
2018-11-29 21:35:10 [INFO    ] Finished processing BAM request
2018-11-29 21:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669947   8 58451 77710029 A  ERROR'
2018-11-29 21:35:10 [DEBUG   ] Got command BAM from MCS: ref #669946
2018-11-29 21:35:10 [INFO    ] Finished processing BAM request
2018-11-29 21:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669946   8 58451 77710033 A  ERROR'
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:35:10 [DEBUG   ] spawn_process: at 2018-11-29 21:35:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:35:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:35:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:35:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:35:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:35:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:35:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:35:16 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-29 21:35:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:35:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:35:49 [DEBUG   ] Got command RPT from MCS: ref #669952
2018-11-29 21:35:49 [DEBUG   ] summary = ERROR
2018-11-29 21:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669952  13 58451 77749813 A  ERRORERROR'
2018-11-29 21:35:49 [DEBUG   ] Got command RPT from MCS: ref #669953
2018-11-29 21:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669953  77 58451 77749814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:35:57 [DEBUG   ] Got command BAM from MCS: ref #669969
2018-11-29 21:35:57 [INFO    ] Finished processing BAM request
2018-11-29 21:35:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669969   8 58451 77757033 A  ERROR'
2018-11-29 21:35:57 [DEBUG   ] Got command BAM from MCS: ref #669970
2018-11-29 21:35:57 [INFO    ] Finished processing BAM request
2018-11-29 21:35:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:35:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669970   8 58451 77757037 A  ERROR'
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:35:57 [DEBUG   ] spawn_process: at 2018-11-29 21:35:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:36:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-29 21:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 21:36:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:36:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:36:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:36:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:36:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:36:16 [WARNING ] (13, 1, 'bot')
2018-11-29 21:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:36:16 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-11-29 21:36:23 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 21:36:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:36:44 [DEBUG   ] Got command BAM from MCS: ref #669972
2018-11-29 21:36:44 [INFO    ] Finished processing BAM request
2018-11-29 21:36:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669972   8 58451 77804025 A  ERROR'
2018-11-29 21:36:44 [DEBUG   ] Got command BAM from MCS: ref #669971
2018-11-29 21:36:44 [INFO    ] Finished processing BAM request
2018-11-29 21:36:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669971   8 58451 77804029 A  ERROR'
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:36:44 [DEBUG   ] spawn_process: at 2018-11-29 21:36:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:37:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 21:37:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:37:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:37:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:37:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:37:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:37:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:37:17 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-11-29 21:37:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:37:31 [DEBUG   ] Got command BAM from MCS: ref #669973
2018-11-29 21:37:31 [INFO    ] Finished processing BAM request
2018-11-29 21:37:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669973   8 58451 77851033 A  ERROR'
2018-11-29 21:37:31 [DEBUG   ] Got command BAM from MCS: ref #669974
2018-11-29 21:37:31 [INFO    ] Finished processing BAM request
2018-11-29 21:37:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669974   8 58451 77851037 A  ERROR'
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:37:31 [DEBUG   ] spawn_process: at 2018-11-29 21:37:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:37:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:38:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 21:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:38:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:38:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:38:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:38:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:38:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:38:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:38:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:38:17 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-11-29 21:38:18 [DEBUG   ] Got command BAM from MCS: ref #669979
2018-11-29 21:38:18 [INFO    ] Finished processing BAM request
2018-11-29 21:38:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669979   8 58451 77898033 A  ERROR'
2018-11-29 21:38:18 [DEBUG   ] Got command BAM from MCS: ref #669980
2018-11-29 21:38:18 [INFO    ] Finished processing BAM request
2018-11-29 21:38:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669980   8 58451 77898037 A  ERROR'
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:38:18 [DEBUG   ] spawn_process: at 2018-11-29 21:38:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:38:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:38:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:39:02 [DEBUG   ] Got command RPT from MCS: ref #669981
2018-11-29 21:39:02 [DEBUG   ] summary = ERROR
2018-11-29 21:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669981  13 58451 77942433 A  ERRORERROR'
2018-11-29 21:39:02 [DEBUG   ] Got command RPT from MCS: ref #669982
2018-11-29 21:39:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669982  77 58451 77942637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:39:02 [DEBUG   ] Got command RPT from MCS: ref #669983
2018-11-29 21:39:02 [DEBUG   ] summary = ERROR
2018-11-29 21:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669983  13 58451 77942841 A  ERRORERROR'
2018-11-29 21:39:03 [DEBUG   ] Got command RPT from MCS: ref #669984
2018-11-29 21:39:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669984  77 58451 77943037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:39:03 [DEBUG   ] Got command RPT from MCS: ref #669985
2018-11-29 21:39:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669985  12 58451 77943241 A  ERRORB¤ff'
2018-11-29 21:39:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:39:05 [DEBUG   ] Got command BAM from MCS: ref #669986
2018-11-29 21:39:05 [INFO    ] Finished processing BAM request
2018-11-29 21:39:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669986   8 58451 77945033 A  ERROR'
2018-11-29 21:39:05 [DEBUG   ] Got command BAM from MCS: ref #669987
2018-11-29 21:39:05 [INFO    ] Finished processing BAM request
2018-11-29 21:39:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669987   8 58451 77945037 A  ERROR'
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:39:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:39:05 [DEBUG   ] spawn_process: at 2018-11-29 21:39:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 21:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:39:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:39:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:39:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:39:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:39:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:39:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:39:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:39:17 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-11-29 21:39:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:39:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:39:52 [DEBUG   ] Got command BAM from MCS: ref #669988
2018-11-29 21:39:52 [INFO    ] Finished processing BAM request
2018-11-29 21:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669988   8 58451 77992033 A  ERROR'
2018-11-29 21:39:52 [DEBUG   ] Got command BAM from MCS: ref #669989
2018-11-29 21:39:52 [INFO    ] Finished processing BAM request
2018-11-29 21:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669989   8 58451 77992037 A  ERROR'
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:39:52 [DEBUG   ] spawn_process: at 2018-11-29 21:39:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:40:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:40:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:40:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:40:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:40:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:40:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:40:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:40:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:40:17 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-11-29 21:40:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:40:39 [DEBUG   ] Got command BAM from MCS: ref #669991
2018-11-29 21:40:39 [INFO    ] Finished processing BAM request
2018-11-29 21:40:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669991   8 58451 78039033 A  ERROR'
2018-11-29 21:40:39 [DEBUG   ] Got command BAM from MCS: ref #669990
2018-11-29 21:40:39 [INFO    ] Finished processing BAM request
2018-11-29 21:40:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   669990   8 58451 78039037 A  ERROR'
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:40:39 [DEBUG   ] spawn_process: at 2018-11-29 21:40:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:40:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:40:49 [DEBUG   ] Got command RPT from MCS: ref #669992
2018-11-29 21:40:49 [DEBUG   ] summary = ERROR
2018-11-29 21:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669992  13 58451 78049809 A  ERRORERROR'
2018-11-29 21:40:49 [DEBUG   ] Got command RPT from MCS: ref #669993
2018-11-29 21:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   669993  77 58451 78049810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:41:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 21:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:41:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:41:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:41:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:41:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:41:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:41:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:41:17 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-11-29 21:41:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:41:26 [DEBUG   ] Got command BAM from MCS: ref #670013
2018-11-29 21:41:26 [INFO    ] Finished processing BAM request
2018-11-29 21:41:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670013   8 58451 78086033 A  ERROR'
2018-11-29 21:41:26 [DEBUG   ] Got command BAM from MCS: ref #670014
2018-11-29 21:41:26 [INFO    ] Finished processing BAM request
2018-11-29 21:41:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670014   8 58451 78086037 A  ERROR'
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:41:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:41:26 [DEBUG   ] spawn_process: at 2018-11-29 21:41:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:41:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:42:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:42:13 [DEBUG   ] Got command BAM from MCS: ref #670016
2018-11-29 21:42:13 [INFO    ] Finished processing BAM request
2018-11-29 21:42:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670016   8 58451 78133025 A  ERROR'
2018-11-29 21:42:13 [DEBUG   ] Got command BAM from MCS: ref #670015
2018-11-29 21:42:13 [INFO    ] Finished processing BAM request
2018-11-29 21:42:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670015   8 58451 78133029 A  ERROR'
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:42:13 [DEBUG   ] spawn_process: at 2018-11-29 21:42:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:42:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:42:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:42:18 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:42:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:42:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:42:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:42:18 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-11-29 21:42:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:42:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:43:00 [DEBUG   ] Got command BAM from MCS: ref #670017
2018-11-29 21:43:00 [INFO    ] Finished processing BAM request
2018-11-29 21:43:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670017   8 58451 78180025 A  ERROR'
2018-11-29 21:43:00 [DEBUG   ] Got command BAM from MCS: ref #670018
2018-11-29 21:43:00 [INFO    ] Finished processing BAM request
2018-11-29 21:43:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670018   8 58451 78180029 A  ERROR'
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:43:00 [DEBUG   ] spawn_process: at 2018-11-29 21:43:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:43:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:43:18 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:43:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:43:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:43:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:43:18 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-11-29 21:43:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:43:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:43:47 [DEBUG   ] Got command BAM from MCS: ref #670021
2018-11-29 21:43:47 [INFO    ] Finished processing BAM request
2018-11-29 21:43:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670021   8 58451 78227033 A  ERROR'
2018-11-29 21:43:47 [DEBUG   ] Got command BAM from MCS: ref #670022
2018-11-29 21:43:47 [INFO    ] Finished processing BAM request
2018-11-29 21:43:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:43:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670022   8 58451 78227037 A  ERROR'
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:43:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:43:47 [DEBUG   ] spawn_process: at 2018-11-29 21:43:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:44:02 [DEBUG   ] Got command RPT from MCS: ref #670023
2018-11-29 21:44:02 [DEBUG   ] summary = ERROR
2018-11-29 21:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670023  13 58451 78242513 A  ERRORERROR'
2018-11-29 21:44:02 [DEBUG   ] Got command RPT from MCS: ref #670024
2018-11-29 21:44:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670024  77 58451 78242713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:44:02 [DEBUG   ] Got command RPT from MCS: ref #670025
2018-11-29 21:44:02 [DEBUG   ] summary = ERROR
2018-11-29 21:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670025  13 58451 78242917 A  ERRORERROR'
2018-11-29 21:44:03 [DEBUG   ] Got command RPT from MCS: ref #670026
2018-11-29 21:44:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670026  77 58451 78243121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:44:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:44:03 [DEBUG   ] Got command RPT from MCS: ref #670028
2018-11-29 21:44:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670028  12 58451 78243325 A  ERRORB¤ff'
2018-11-29 21:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:44:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:44:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:44:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:44:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:44:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:44:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:44:17 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-29 21:44:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:44:34 [DEBUG   ] Got command BAM from MCS: ref #670038
2018-11-29 21:44:34 [INFO    ] Finished processing BAM request
2018-11-29 21:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670038   8 58451 78274029 A  ERROR'
2018-11-29 21:44:34 [DEBUG   ] Got command BAM from MCS: ref #670037
2018-11-29 21:44:34 [INFO    ] Finished processing BAM request
2018-11-29 21:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670037   8 58451 78274033 A  ERROR'
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:44:34 [DEBUG   ] spawn_process: at 2018-11-29 21:44:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:44:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:45:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:45:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:45:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:45:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:45:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:45:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:45:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:45:17 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-29 21:45:21 [DEBUG   ] Got command BAM from MCS: ref #670040
2018-11-29 21:45:21 [INFO    ] Finished processing BAM request
2018-11-29 21:45:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670040   8 58451 78321029 A  ERROR'
2018-11-29 21:45:21 [DEBUG   ] Got command BAM from MCS: ref #670039
2018-11-29 21:45:21 [INFO    ] Finished processing BAM request
2018-11-29 21:45:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:45:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670039   8 58451 78321033 A  ERROR'
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:45:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:45:21 [DEBUG   ] spawn_process: at 2018-11-29 21:45:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:45:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:45:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:45:49 [DEBUG   ] Got command RPT from MCS: ref #670041
2018-11-29 21:45:49 [DEBUG   ] summary = ERROR
2018-11-29 21:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670041  13 58451 78349942 A  ERRORERROR'
2018-11-29 21:45:49 [DEBUG   ] Got command RPT from MCS: ref #670042
2018-11-29 21:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670042  77 58451 78349942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:46:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:46:08 [DEBUG   ] Got command BAM from MCS: ref #670058
2018-11-29 21:46:08 [INFO    ] Finished processing BAM request
2018-11-29 21:46:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670058   8 58451 78368030 A  ERROR'
2018-11-29 21:46:08 [DEBUG   ] Got command BAM from MCS: ref #670059
2018-11-29 21:46:08 [INFO    ] Finished processing BAM request
2018-11-29 21:46:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670059   8 58451 78368034 A  ERROR'
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:46:08 [DEBUG   ] spawn_process: at 2018-11-29 21:46:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:46:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:46:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:46:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:46:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:46:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:46:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:46:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:46:17 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-29 21:46:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:46:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:46:55 [DEBUG   ] Got command BAM from MCS: ref #670060
2018-11-29 21:46:55 [INFO    ] Finished processing BAM request
2018-11-29 21:46:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670060   8 58451 78415030 A  ERROR'
2018-11-29 21:46:55 [DEBUG   ] Got command BAM from MCS: ref #670061
2018-11-29 21:46:55 [INFO    ] Finished processing BAM request
2018-11-29 21:46:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670061   8 58451 78415034 A  ERROR'
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:46:55 [DEBUG   ] spawn_process: at 2018-11-29 21:46:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:47:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 21:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:47:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:47:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:47:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:47:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:47:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:47:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:47:17 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-11-29 21:47:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:47:42 [DEBUG   ] Got command BAM from MCS: ref #670067
2018-11-29 21:47:42 [INFO    ] Finished processing BAM request
2018-11-29 21:47:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:47:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670067   8 58451 78462030 A  ERROR'
2018-11-29 21:47:42 [DEBUG   ] Got command BAM from MCS: ref #670066
2018-11-29 21:47:42 [INFO    ] Finished processing BAM request
2018-11-29 21:47:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:47:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670066   8 58451 78462034 A  ERROR'
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:47:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:47:42 [DEBUG   ] spawn_process: at 2018-11-29 21:47:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:47:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:48:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 21:48:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:48:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:48:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:48:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:48:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:48:17 [WARNING ] (13, 1, 'bot')
2018-11-29 21:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:48:17 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-11-29 21:48:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:48:29 [DEBUG   ] Got command BAM from MCS: ref #670069
2018-11-29 21:48:29 [INFO    ] Finished processing BAM request
2018-11-29 21:48:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670069   8 58451 78509033 A  ERROR'
2018-11-29 21:48:29 [DEBUG   ] Got command BAM from MCS: ref #670068
2018-11-29 21:48:29 [INFO    ] Finished processing BAM request
2018-11-29 21:48:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670068   8 58451 78509037 A  ERROR'
2018-11-29 21:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:48:29 [DEBUG   ] spawn_process: at 2018-11-29 21:48:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:48:30 [DEBUG   ] spawn_process: at 2018-11-29 21:48:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:48:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:49:02 [DEBUG   ] Got command RPT from MCS: ref #670070
2018-11-29 21:49:02 [DEBUG   ] summary = ERROR
2018-11-29 21:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670070  13 58451 78542609 A  ERRORERROR'
2018-11-29 21:49:02 [DEBUG   ] Got command RPT from MCS: ref #670071
2018-11-29 21:49:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670071  77 58451 78542801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:49:03 [DEBUG   ] Got command RPT from MCS: ref #670072
2018-11-29 21:49:03 [DEBUG   ] summary = ERROR
2018-11-29 21:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670072  13 58451 78543005 A  ERRORERROR'
2018-11-29 21:49:03 [DEBUG   ] Got command RPT from MCS: ref #670073
2018-11-29 21:49:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670073  77 58451 78543209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:49:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:49:03 [DEBUG   ] Got command RPT from MCS: ref #670074
2018-11-29 21:49:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670074  12 58451 78543401 A  ERRORB£ff'
2018-11-29 21:49:16 [DEBUG   ] Got command BAM from MCS: ref #670075
2018-11-29 21:49:16 [INFO    ] Finished processing BAM request
2018-11-29 21:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670075   8 58451 78556029 A  ERROR'
2018-11-29 21:49:16 [DEBUG   ] Got command BAM from MCS: ref #670076
2018-11-29 21:49:16 [INFO    ] Finished processing BAM request
2018-11-29 21:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670076   8 58451 78556033 A  ERROR'
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:49:16 [DEBUG   ] spawn_process: at 2018-11-29 21:49:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 21:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 21:49:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:49:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 21:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 21:49:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:49:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:49:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:49:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:49:18 [DEBUG   ] Finished updating board flags in 1.341 seconds
2018-11-29 21:49:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:49:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 21:50:03 [DEBUG   ] Got command BAM from MCS: ref #670077
2018-11-29 21:50:03 [INFO    ] Finished processing BAM request
2018-11-29 21:50:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670077   8 58451 78603033 A  ERROR'
2018-11-29 21:50:03 [DEBUG   ] Got command BAM from MCS: ref #670078
2018-11-29 21:50:03 [INFO    ] Finished processing BAM request
2018-11-29 21:50:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670078   8 58451 78603037 A  ERROR'
2018-11-29 21:50:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:50:03 [DEBUG   ] spawn_process: at 2018-11-29 21:50:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 21:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:50:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:50:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:50:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:50:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:50:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:50:18 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-11-29 21:50:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 21:50:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:50:49 [DEBUG   ] Got command RPT from MCS: ref #670085
2018-11-29 21:50:49 [DEBUG   ] summary = ERROR
2018-11-29 21:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670085  13 58451 78649813 A  ERRORERROR'
2018-11-29 21:50:49 [DEBUG   ] Got command RPT from MCS: ref #670086
2018-11-29 21:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670086  77 58451 78649814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:50:50 [DEBUG   ] Got command BAM from MCS: ref #670083
2018-11-29 21:50:50 [INFO    ] Finished processing BAM request
2018-11-29 21:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670083   8 58451 78650033 A  ERROR'
2018-11-29 21:50:50 [DEBUG   ] Got command BAM from MCS: ref #670084
2018-11-29 21:50:50 [INFO    ] Finished processing BAM request
2018-11-29 21:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670084   8 58451 78650037 A  ERROR'
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:50:50 [DEBUG   ] spawn_process: at 2018-11-29 21:50:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:51:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 21:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 21:51:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:51:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:51:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:51:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:51:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:51:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:51:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:51:18 [DEBUG   ] Finished updating board flags in 1.116 seconds
2018-11-29 21:51:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:51:37 [DEBUG   ] Got command BAM from MCS: ref #670102
2018-11-29 21:51:37 [INFO    ] Finished processing BAM request
2018-11-29 21:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670102   8 58451 78697029 A  ERROR'
2018-11-29 21:51:37 [DEBUG   ] Got command BAM from MCS: ref #670103
2018-11-29 21:51:37 [INFO    ] Finished processing BAM request
2018-11-29 21:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670103   8 58451 78697033 A  ERROR'
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:51:37 [DEBUG   ] spawn_process: at 2018-11-29 21:51:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:51:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 21:52:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 21:52:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:52:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:52:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 21:52:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:52:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:52:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:52:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:52:18 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-11-29 21:52:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:52:24 [DEBUG   ] Got command BAM from MCS: ref #670105
2018-11-29 21:52:24 [INFO    ] Finished processing BAM request
2018-11-29 21:52:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670105   8 58451 78744025 A  ERROR'
2018-11-29 21:52:24 [DEBUG   ] Got command BAM from MCS: ref #670104
2018-11-29 21:52:24 [INFO    ] Finished processing BAM request
2018-11-29 21:52:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670104   8 58451 78744029 A  ERROR'
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:52:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:52:24 [DEBUG   ] spawn_process: at 2018-11-29 21:52:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:52:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:53:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:53:11 [DEBUG   ] Got command BAM from MCS: ref #670106
2018-11-29 21:53:11 [INFO    ] Finished processing BAM request
2018-11-29 21:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670106   8 58451 78791033 A  ERROR'
2018-11-29 21:53:11 [DEBUG   ] Got command BAM from MCS: ref #670107
2018-11-29 21:53:11 [INFO    ] Finished processing BAM request
2018-11-29 21:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670107   8 58451 78791037 A  ERROR'
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:53:11 [DEBUG   ] spawn_process: at 2018-11-29 21:53:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:53:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:53:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 21:53:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:53:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:53:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:53:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:53:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:53:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:53:18 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-29 21:53:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:53:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:53:58 [DEBUG   ] Got command BAM from MCS: ref #670114
2018-11-29 21:53:58 [INFO    ] Finished processing BAM request
2018-11-29 21:53:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670114   8 58451 78838025 A  ERROR'
2018-11-29 21:53:58 [DEBUG   ] Got command BAM from MCS: ref #670115
2018-11-29 21:53:58 [INFO    ] Finished processing BAM request
2018-11-29 21:53:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670115   8 58451 78838029 A  ERROR'
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 21:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 21:53:58 [DEBUG   ] spawn_process: at 2018-11-29 21:53:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 21:54:02 [DEBUG   ] Got command RPT from MCS: ref #670116
2018-11-29 21:54:02 [DEBUG   ] summary = ERROR
2018-11-29 21:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670116  13 58451 78842685 A  ERRORERROR'
2018-11-29 21:54:02 [DEBUG   ] Got command RPT from MCS: ref #670117
2018-11-29 21:54:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670117  77 58451 78842887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:54:03 [DEBUG   ] Got command RPT from MCS: ref #670118
2018-11-29 21:54:03 [DEBUG   ] summary = ERROR
2018-11-29 21:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670118  13 58451 78843101 A  ERRORERROR'
2018-11-29 21:54:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:54:03 [DEBUG   ] Got command RPT from MCS: ref #670120
2018-11-29 21:54:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670120  77 58451 78843293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:54:03 [DEBUG   ] Got command RPT from MCS: ref #670121
2018-11-29 21:54:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670121  12 58451 78843497 A  ERRORB¢ff'
2018-11-29 21:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-29 21:54:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:54:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:54:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:54:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:54:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:54:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:54:18 [DEBUG   ] Finished updating board flags in 1.291 seconds
2018-11-29 21:54:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:54:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:54:45 [DEBUG   ] Got command BAM from MCS: ref #670126
2018-11-29 21:54:45 [INFO    ] Finished processing BAM request
2018-11-29 21:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670126   8 58451 78885029 A  ERROR'
2018-11-29 21:54:45 [DEBUG   ] Got command BAM from MCS: ref #670127
2018-11-29 21:54:45 [INFO    ] Finished processing BAM request
2018-11-29 21:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670127   8 58451 78885033 A  ERROR'
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 21:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 21:54:45 [DEBUG   ] spawn_process: at 2018-11-29 21:54:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 21:55:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 21:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:55:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:55:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:55:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:55:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:55:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:55:18 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-29 21:55:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:55:32 [DEBUG   ] Got command BAM from MCS: ref #670129
2018-11-29 21:55:32 [INFO    ] Finished processing BAM request
2018-11-29 21:55:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670129   8 58451 78932033 A  ERROR'
2018-11-29 21:55:32 [DEBUG   ] Got command BAM from MCS: ref #670128
2018-11-29 21:55:32 [INFO    ] Finished processing BAM request
2018-11-29 21:55:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670128   8 58451 78932037 A  ERROR'
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 21:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 21:55:32 [DEBUG   ] spawn_process: at 2018-11-29 21:55:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 21:55:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:55:49 [DEBUG   ] Got command RPT from MCS: ref #670130
2018-11-29 21:55:49 [DEBUG   ] summary = ERROR
2018-11-29 21:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670130  13 58451 78949817 A  ERRORERROR'
2018-11-29 21:55:49 [DEBUG   ] Got command RPT from MCS: ref #670131
2018-11-29 21:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670131  77 58451 78949818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:56:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 21:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 21:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 21:56:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:56:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:56:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:56:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:56:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:56:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:56:18 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-29 21:56:19 [DEBUG   ] Got command BAM from MCS: ref #670151
2018-11-29 21:56:19 [INFO    ] Finished processing BAM request
2018-11-29 21:56:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670151   8 58451 78979033 A  ERROR'
2018-11-29 21:56:19 [DEBUG   ] Got command BAM from MCS: ref #670152
2018-11-29 21:56:19 [INFO    ] Finished processing BAM request
2018-11-29 21:56:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670152   8 58451 78979037 A  ERROR'
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:56:19 [DEBUG   ] spawn_process: at 2018-11-29 21:56:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:56:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:56:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:57:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:57:06 [DEBUG   ] Got command BAM from MCS: ref #670153
2018-11-29 21:57:06 [INFO    ] Finished processing BAM request
2018-11-29 21:57:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:57:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670153   8 58451 79026025 A  ERROR'
2018-11-29 21:57:06 [DEBUG   ] Got command BAM from MCS: ref #670154
2018-11-29 21:57:06 [INFO    ] Finished processing BAM request
2018-11-29 21:57:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:57:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670154   8 58451 79026029 A  ERROR'
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 21:57:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 21:57:06 [DEBUG   ] spawn_process: at 2018-11-29 21:57:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 21:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 21:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 21:57:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:57:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:57:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:57:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:57:18 [WARNING ] (13, 1, 'bot')
2018-11-29 21:57:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:57:18 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-11-29 21:57:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:57:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:57:53 [DEBUG   ] Got command BAM from MCS: ref #670155
2018-11-29 21:57:53 [INFO    ] Finished processing BAM request
2018-11-29 21:57:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:57:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670155   8 58451 79073033 A  ERROR'
2018-11-29 21:57:53 [DEBUG   ] Got command BAM from MCS: ref #670156
2018-11-29 21:57:53 [INFO    ] Finished processing BAM request
2018-11-29 21:57:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:57:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670156   8 58451 79073037 A  ERROR'
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:57:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:57:53 [DEBUG   ] spawn_process: at 2018-11-29 21:57:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:58:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:58:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 21:58:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:58:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:58:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:58:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:58:19 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-11-29 21:58:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:58:40 [DEBUG   ] Got command BAM from MCS: ref #670157
2018-11-29 21:58:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670157   8 58451 79120033 A  ERROR'
2018-11-29 21:58:40 [DEBUG   ] Got command BAM from MCS: ref #670158
2018-11-29 21:58:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670158   8 58451 79120037 A  ERROR'
2018-11-29 21:58:40 [INFO    ] Finished processing BAM request
2018-11-29 21:58:40 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-29 21:58:40 [INFO    ] Finished processing BAM request
2018-11-29 21:58:40 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-29 21:58:40 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-29 21:58:40 [DEBUG   ] 
2018-11-29 21:58:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 21:59:02 [DEBUG   ] Got command RPT from MCS: ref #670159
2018-11-29 21:59:02 [DEBUG   ] summary = ERROR
2018-11-29 21:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670159  13 58451 79142777 A  ERRORERROR'
2018-11-29 21:59:02 [DEBUG   ] Got command RPT from MCS: ref #670160
2018-11-29 21:59:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670160  77 58451 79142977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:59:03 [DEBUG   ] Got command RPT from MCS: ref #670161
2018-11-29 21:59:03 [DEBUG   ] summary = ERROR
2018-11-29 21:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670161  13 58451 79143181 A  ERRORERROR'
2018-11-29 21:59:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 21:59:03 [DEBUG   ] Got command RPT from MCS: ref #670162
2018-11-29 21:59:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 21:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670162  77 58451 79143373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 21:59:03 [DEBUG   ] Got command RPT from MCS: ref #670163
2018-11-29 21:59:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 21:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670163  12 58451 79143577 A  ERRORB£ff'
2018-11-29 21:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-11-29 21:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 21:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 21:59:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 21:59:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:59:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:59:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:59:19 [WARNING ] (13, 1, 'bot')
2018-11-29 21:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 21:59:19 [DEBUG   ] Finished updating board flags in 1.311 seconds
2018-11-29 21:59:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 21:59:27 [DEBUG   ] Got command BAM from MCS: ref #670169
2018-11-29 21:59:27 [INFO    ] Finished processing BAM request
2018-11-29 21:59:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670169   8 58451 79167025 A  ERROR'
2018-11-29 21:59:27 [DEBUG   ] Got command BAM from MCS: ref #670168
2018-11-29 21:59:27 [INFO    ] Finished processing BAM request
2018-11-29 21:59:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 21:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670168   8 58451 79167029 A  ERROR'
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 21:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 21:59:27 [DEBUG   ] spawn_process: at 2018-11-29 21:59:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 21:59:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:00:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:00:14 [DEBUG   ] Got command BAM from MCS: ref #670171
2018-11-29 22:00:14 [INFO    ] Finished processing BAM request
2018-11-29 22:00:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670171   8 58451 79214033 A  ERROR'
2018-11-29 22:00:14 [DEBUG   ] Got command BAM from MCS: ref #670170
2018-11-29 22:00:14 [INFO    ] Finished processing BAM request
2018-11-29 22:00:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670170   8 58451 79214037 A  ERROR'
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 22:00:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 22:00:14 [DEBUG   ] spawn_process: at 2018-11-29 22:00:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 22:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:00:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:00:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:00:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:00:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:00:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:00:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:00:19 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-29 22:00:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:00:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:00:49 [DEBUG   ] Got command RPT from MCS: ref #670172
2018-11-29 22:00:49 [DEBUG   ] summary = ERROR
2018-11-29 22:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670172  13 58451 79249813 A  ERRORERROR'
2018-11-29 22:00:49 [DEBUG   ] Got command RPT from MCS: ref #670173
2018-11-29 22:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670173  77 58451 79249814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:01:01 [DEBUG   ] Got command BAM from MCS: ref #670189
2018-11-29 22:01:01 [INFO    ] Finished processing BAM request
2018-11-29 22:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670189   8 58451 79261025 A  ERROR'
2018-11-29 22:01:01 [DEBUG   ] Got command BAM from MCS: ref #670190
2018-11-29 22:01:01 [INFO    ] Finished processing BAM request
2018-11-29 22:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670190   8 58451 79261033 A  ERROR'
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 22:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 22:01:01 [DEBUG   ] spawn_process: at 2018-11-29 22:01:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 22:01:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:01:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:01:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:01:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:01:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:01:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:01:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:01:19 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-29 22:01:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:01:43 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 22:01:48 [DEBUG   ] Got command BAM from MCS: ref #670191
2018-11-29 22:01:48 [INFO    ] Finished processing BAM request
2018-11-29 22:01:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670191   8 58451 79308033 A  ERROR'
2018-11-29 22:01:48 [DEBUG   ] Got command BAM from MCS: ref #670192
2018-11-29 22:01:48 [INFO    ] Finished processing BAM request
2018-11-29 22:01:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670192   8 58451 79308037 A  ERROR'
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:01:48 [DEBUG   ] spawn_process: at 2018-11-29 22:01:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:02:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:02:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-29 22:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:02:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:02:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:02:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:02:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:02:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:02:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:02:19 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-29 22:02:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 22:02:35 [DEBUG   ] Got command BAM from MCS: ref #670198
2018-11-29 22:02:35 [INFO    ] Finished processing BAM request
2018-11-29 22:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670198   8 58451 79355033 A  ERROR'
2018-11-29 22:02:35 [DEBUG   ] Got command BAM from MCS: ref #670197
2018-11-29 22:02:35 [INFO    ] Finished processing BAM request
2018-11-29 22:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670197   8 58451 79355037 A  ERROR'
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:02:35 [DEBUG   ] spawn_process: at 2018-11-29 22:02:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:02:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:03:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 22:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2018-11-29 22:03:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:03:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:03:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 22:03:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:03:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:03:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:03:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:03:19 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-29 22:03:22 [DEBUG   ] Got command BAM from MCS: ref #670199
2018-11-29 22:03:22 [INFO    ] Finished processing BAM request
2018-11-29 22:03:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670199   8 58451 79402029 A  ERROR'
2018-11-29 22:03:22 [DEBUG   ] Got command BAM from MCS: ref #670200
2018-11-29 22:03:22 [INFO    ] Finished processing BAM request
2018-11-29 22:03:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670200   8 58451 79402033 A  ERROR'
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:03:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:03:22 [DEBUG   ] spawn_process: at 2018-11-29 22:03:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:03:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:03:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:04:02 [DEBUG   ] Got command RPT from MCS: ref #670203
2018-11-29 22:04:02 [DEBUG   ] summary = ERROR
2018-11-29 22:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670203  13 58451 79442861 A  ERRORERROR'
2018-11-29 22:04:03 [DEBUG   ] Got command RPT from MCS: ref #670204
2018-11-29 22:04:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670204  77 58451 79443066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:04:03 [DEBUG   ] Got command RPT from MCS: ref #670205
2018-11-29 22:04:03 [DEBUG   ] summary = ERROR
2018-11-29 22:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670205  13 58451 79443257 A  ERRORERROR'
2018-11-29 22:04:03 [DEBUG   ] Got command RPT from MCS: ref #670207
2018-11-29 22:04:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670207  77 58451 79443461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:04:03 [DEBUG   ] Got command RPT from MCS: ref #670208
2018-11-29 22:04:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670208  12 58451 79443665 A  ERRORB¤ff'
2018-11-29 22:04:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:04:09 [DEBUG   ] Got command BAM from MCS: ref #670214
2018-11-29 22:04:09 [INFO    ] Finished processing BAM request
2018-11-29 22:04:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670214   8 58451 79449033 A  ERROR'
2018-11-29 22:04:09 [DEBUG   ] Got command BAM from MCS: ref #670213
2018-11-29 22:04:09 [INFO    ] Finished processing BAM request
2018-11-29 22:04:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670213   8 58451 79449037 A  ERROR'
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:04:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:04:09 [DEBUG   ] spawn_process: at 2018-11-29 22:04:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 22:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 22:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:04:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 22:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 22:04:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:04:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 22:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:04:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:04:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:04:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:04:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:04:19 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-29 22:04:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:04:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 22:04:56 [DEBUG   ] Got command BAM from MCS: ref #670216
2018-11-29 22:04:56 [INFO    ] Finished processing BAM request
2018-11-29 22:04:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670216   8 58451 79496033 A  ERROR'
2018-11-29 22:04:56 [DEBUG   ] Got command BAM from MCS: ref #670215
2018-11-29 22:04:56 [INFO    ] Finished processing BAM request
2018-11-29 22:04:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670215   8 58451 79496037 A  ERROR'
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 22:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 22:04:56 [DEBUG   ] spawn_process: at 2018-11-29 22:04:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 22:05:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 22:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:05:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2018-11-29 22:05:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:05:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 22:05:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:05:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:05:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:05:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:05:19 [DEBUG   ] Finished updating board flags in 1.060 seconds
2018-11-29 22:05:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:05:43 [DEBUG   ] Got command BAM from MCS: ref #670222
2018-11-29 22:05:43 [INFO    ] Finished processing BAM request
2018-11-29 22:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670222   8 58451 79543025 A  ERROR'
2018-11-29 22:05:43 [DEBUG   ] Got command BAM from MCS: ref #670221
2018-11-29 22:05:43 [INFO    ] Finished processing BAM request
2018-11-29 22:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670221   8 58451 79543029 A  ERROR'
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:05:43 [DEBUG   ] spawn_process: at 2018-11-29 22:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:05:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 22:05:49 [DEBUG   ] Got command RPT from MCS: ref #670223
2018-11-29 22:05:49 [DEBUG   ] summary = ERROR
2018-11-29 22:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670223  13 58451 79549813 A  ERRORERROR'
2018-11-29 22:05:49 [DEBUG   ] Got command RPT from MCS: ref #670224
2018-11-29 22:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670224  77 58451 79549814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:06:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:06:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-29 22:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:06:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:06:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 22:06:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:06:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:06:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:06:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:06:19 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-11-29 22:06:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 22:06:30 [DEBUG   ] Got command BAM from MCS: ref #670240
2018-11-29 22:06:30 [INFO    ] Finished processing BAM request
2018-11-29 22:06:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670240   8 58451 79590033 A  ERROR'
2018-11-29 22:06:30 [DEBUG   ] Got command BAM from MCS: ref #670241
2018-11-29 22:06:30 [INFO    ] Finished processing BAM request
2018-11-29 22:06:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670241   8 58451 79590037 A  ERROR'
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 22:06:30 [DEBUG   ] spawn_process: at 2018-11-29 22:06:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 22:06:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 22:07:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 22:07:17 [DEBUG   ] Got command BAM from MCS: ref #670243
2018-11-29 22:07:17 [INFO    ] Finished processing BAM request
2018-11-29 22:07:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670243   8 58451 79637025 A  ERROR'
2018-11-29 22:07:17 [DEBUG   ] Got command BAM from MCS: ref #670242
2018-11-29 22:07:17 [INFO    ] Finished processing BAM request
2018-11-29 22:07:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670242   8 58451 79637029 A  ERROR'
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:07:17 [DEBUG   ] spawn_process: at 2018-11-29 22:07:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:07:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 22:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:07:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:07:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 22:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 22:07:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:07:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:07:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:07:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:07:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:07:19 [DEBUG   ] Finished updating board flags in 1.297 seconds
2018-11-29 22:07:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 22:07:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 22:08:04 [DEBUG   ] Got command BAM from MCS: ref #670244
2018-11-29 22:08:04 [INFO    ] Finished processing BAM request
2018-11-29 22:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670244   8 58451 79684026 A  ERROR'
2018-11-29 22:08:04 [DEBUG   ] Got command BAM from MCS: ref #670245
2018-11-29 22:08:04 [INFO    ] Finished processing BAM request
2018-11-29 22:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670245   8 58451 79684030 A  ERROR'
2018-11-29 22:08:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:08:04 [DEBUG   ] spawn_process: at 2018-11-29 22:08:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:08:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:08:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:08:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:08:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:08:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:08:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:08:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:08:19 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-29 22:08:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-29 22:08:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:08:51 [DEBUG   ] Got command BAM from MCS: ref #670250
2018-11-29 22:08:51 [INFO    ] Finished processing BAM request
2018-11-29 22:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670250   8 58451 79731026 A  ERROR'
2018-11-29 22:08:51 [DEBUG   ] Got command BAM from MCS: ref #670251
2018-11-29 22:08:51 [INFO    ] Finished processing BAM request
2018-11-29 22:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670251   8 58451 79731030 A  ERROR'
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:08:51 [DEBUG   ] spawn_process: at 2018-11-29 22:08:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:09:02 [DEBUG   ] Got command RPT from MCS: ref #670252
2018-11-29 22:09:02 [DEBUG   ] summary = ERROR
2018-11-29 22:09:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670252  13 58451 79742945 A  ERRORERROR'
2018-11-29 22:09:03 [DEBUG   ] Got command RPT from MCS: ref #670253
2018-11-29 22:09:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:09:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670253  77 58451 79743149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:09:03 [DEBUG   ] Got command RPT from MCS: ref #670254
2018-11-29 22:09:03 [DEBUG   ] summary = ERROR
2018-11-29 22:09:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670254  13 58451 79743342 A  ERRORERROR'
2018-11-29 22:09:03 [DEBUG   ] Got command RPT from MCS: ref #670255
2018-11-29 22:09:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:09:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670255  77 58451 79743546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:09:03 [DEBUG   ] Got command RPT from MCS: ref #670256
2018-11-29 22:09:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:09:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670256  12 58451 79743749 A  ERRORB¤ff'
2018-11-29 22:09:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 22:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:09:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 22:09:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:09:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:09:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:09:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:09:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:09:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:09:20 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-11-29 22:09:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:09:38 [DEBUG   ] Got command BAM from MCS: ref #670258
2018-11-29 22:09:38 [INFO    ] Finished processing BAM request
2018-11-29 22:09:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670258   8 58451 79778026 A  ERROR'
2018-11-29 22:09:38 [DEBUG   ] Got command BAM from MCS: ref #670257
2018-11-29 22:09:38 [INFO    ] Finished processing BAM request
2018-11-29 22:09:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670257   8 58451 79778030 A  ERROR'
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:09:38 [DEBUG   ] spawn_process: at 2018-11-29 22:09:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:09:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:10:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 22:10:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:10:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:10:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 22:10:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:10:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:10:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:10:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:10:20 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-29 22:10:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:10:25 [DEBUG   ] Got command BAM from MCS: ref #670259
2018-11-29 22:10:25 [INFO    ] Finished processing BAM request
2018-11-29 22:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670259   8 58451 79825033 A  ERROR'
2018-11-29 22:10:25 [DEBUG   ] Got command BAM from MCS: ref #670260
2018-11-29 22:10:25 [INFO    ] Finished processing BAM request
2018-11-29 22:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670260   8 58451 79825037 A  ERROR'
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:10:25 [DEBUG   ] spawn_process: at 2018-11-29 22:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:10:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:10:49 [DEBUG   ] Got command RPT from MCS: ref #670261
2018-11-29 22:10:49 [DEBUG   ] summary = ERROR
2018-11-29 22:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670261  13 58451 79849817 A  ERRORERROR'
2018-11-29 22:10:49 [DEBUG   ] Got command RPT from MCS: ref #670262
2018-11-29 22:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670262  77 58451 79849818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:11:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:11:12 [DEBUG   ] Got command BAM from MCS: ref #670279
2018-11-29 22:11:12 [INFO    ] Finished processing BAM request
2018-11-29 22:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670279   8 58451 79872034 A  ERROR'
2018-11-29 22:11:12 [DEBUG   ] Got command BAM from MCS: ref #670278
2018-11-29 22:11:12 [INFO    ] Finished processing BAM request
2018-11-29 22:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670278   8 58451 79872038 A  ERROR'
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:11:12 [DEBUG   ] spawn_process: at 2018-11-29 22:11:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 22:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 22:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:11:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:11:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:11:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:11:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:11:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:11:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:11:19 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-29 22:11:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:11:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:11:59 [DEBUG   ] Got command BAM from MCS: ref #670284
2018-11-29 22:11:59 [INFO    ] Finished processing BAM request
2018-11-29 22:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670284   8 58451 79919033 A  ERROR'
2018-11-29 22:11:59 [DEBUG   ] Got command BAM from MCS: ref #670285
2018-11-29 22:11:59 [INFO    ] Finished processing BAM request
2018-11-29 22:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670285   8 58451 79919037 A  ERROR'
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:11:59 [DEBUG   ] spawn_process: at 2018-11-29 22:11:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:12:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:12:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2018-11-29 22:12:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:12:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:12:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:12:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:12:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:12:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:12:20 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-29 22:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:12:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:12:46 [DEBUG   ] Got command BAM from MCS: ref #670286
2018-11-29 22:12:46 [INFO    ] Finished processing BAM request
2018-11-29 22:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670286   8 58451 79966025 A  ERROR'
2018-11-29 22:12:46 [DEBUG   ] Got command BAM from MCS: ref #670287
2018-11-29 22:12:46 [INFO    ] Finished processing BAM request
2018-11-29 22:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670287   8 58451 79966029 A  ERROR'
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:12:46 [DEBUG   ] spawn_process: at 2018-11-29 22:12:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:13:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-29 22:13:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 22:13:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:13:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:13:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 22:13:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:13:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:13:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:13:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:13:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:13:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:13:20 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-29 22:13:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:13:33 [DEBUG   ] Got command BAM from MCS: ref #670289
2018-11-29 22:13:33 [INFO    ] Finished processing BAM request
2018-11-29 22:13:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670289   8 58451 80013033 A  ERROR'
2018-11-29 22:13:33 [DEBUG   ] Got command BAM from MCS: ref #670288
2018-11-29 22:13:33 [INFO    ] Finished processing BAM request
2018-11-29 22:13:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670288   8 58451 80013037 A  ERROR'
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:13:33 [DEBUG   ] spawn_process: at 2018-11-29 22:13:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:13:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:14:03 [DEBUG   ] Got command RPT from MCS: ref #670292
2018-11-29 22:14:03 [DEBUG   ] summary = ERROR
2018-11-29 22:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670292  13 58451 80043057 A  ERRORERROR'
2018-11-29 22:14:03 [DEBUG   ] Got command RPT from MCS: ref #670293
2018-11-29 22:14:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670293  77 58451 80043249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:14:03 [DEBUG   ] Got command RPT from MCS: ref #670294
2018-11-29 22:14:03 [DEBUG   ] summary = ERROR
2018-11-29 22:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670294  13 58451 80043454 A  ERRORERROR'
2018-11-29 22:14:03 [DEBUG   ] Got command RPT from MCS: ref #670296
2018-11-29 22:14:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670296  77 58451 80043657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:14:03 [DEBUG   ] Got command RPT from MCS: ref #670297
2018-11-29 22:14:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670297  12 58451 80043861 A  ERRORB¤ff'
2018-11-29 22:14:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:14:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 22:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 22:14:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:14:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:14:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:14:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:14:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:14:19 [WARNING ] (13, 1, 'bot')
2018-11-29 22:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:14:19 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-11-29 22:14:20 [DEBUG   ] Got command BAM from MCS: ref #670306
2018-11-29 22:14:20 [INFO    ] Finished processing BAM request
2018-11-29 22:14:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670306   8 58451 80060033 A  ERROR'
2018-11-29 22:14:20 [DEBUG   ] Got command BAM from MCS: ref #670307
2018-11-29 22:14:20 [INFO    ] Finished processing BAM request
2018-11-29 22:14:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670307   8 58451 80060037 A  ERROR'
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:14:20 [DEBUG   ] spawn_process: at 2018-11-29 22:14:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:14:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:14:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:15:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:15:08 [DEBUG   ] Got command BAM from MCS: ref #670309
2018-11-29 22:15:08 [INFO    ] Finished processing BAM request
2018-11-29 22:15:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670309   8 58451 80108029 A  ERROR'
2018-11-29 22:15:08 [DEBUG   ] Got command BAM from MCS: ref #670308
2018-11-29 22:15:08 [INFO    ] Finished processing BAM request
2018-11-29 22:15:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670308   8 58451 80108033 A  ERROR'
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:15:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:15:08 [DEBUG   ] spawn_process: at 2018-11-29 22:15:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:15:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 22:15:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:15:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:15:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:15:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:15:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:15:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:15:20 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-29 22:15:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:15:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:15:49 [DEBUG   ] Got command RPT from MCS: ref #670310
2018-11-29 22:15:49 [DEBUG   ] summary = ERROR
2018-11-29 22:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670310  13 58451 80149821 A  ERRORERROR'
2018-11-29 22:15:49 [DEBUG   ] Got command RPT from MCS: ref #670311
2018-11-29 22:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670311  77 58451 80149822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:15:56 [DEBUG   ] Got command BAM from MCS: ref #670328
2018-11-29 22:15:56 [INFO    ] Finished processing BAM request
2018-11-29 22:15:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:15:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670328   8 58451 80156029 A  ERROR'
2018-11-29 22:15:56 [DEBUG   ] Got command BAM from MCS: ref #670327
2018-11-29 22:15:56 [INFO    ] Finished processing BAM request
2018-11-29 22:15:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:15:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670327   8 58451 80156033 A  ERROR'
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:15:56 [DEBUG   ] spawn_process: at 2018-11-29 22:15:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:16:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:16:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:16:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:16:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:16:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:16:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:16:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:16:20 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-11-29 22:16:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:16:44 [DEBUG   ] Got command BAM from MCS: ref #670330
2018-11-29 22:16:44 [INFO    ] Finished processing BAM request
2018-11-29 22:16:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670330   8 58451 80204029 A  ERROR'
2018-11-29 22:16:44 [DEBUG   ] Got command BAM from MCS: ref #670329
2018-11-29 22:16:44 [INFO    ] Finished processing BAM request
2018-11-29 22:16:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670329   8 58451 80204033 A  ERROR'
2018-11-29 22:16:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:16:44 [DEBUG   ] spawn_process: at 2018-11-29 22:16:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:17:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 22:17:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:17:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:17:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:17:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:17:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:17:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:17:20 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-29 22:17:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:17:32 [DEBUG   ] Got command BAM from MCS: ref #670335
2018-11-29 22:17:32 [INFO    ] Finished processing BAM request
2018-11-29 22:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670335   8 58451 80252033 A  ERROR'
2018-11-29 22:17:32 [DEBUG   ] Got command BAM from MCS: ref #670336
2018-11-29 22:17:32 [INFO    ] Finished processing BAM request
2018-11-29 22:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670336   8 58451 80252037 A  ERROR'
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:17:32 [DEBUG   ] spawn_process: at 2018-11-29 22:17:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:17:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:18:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 22:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:18:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:18:20 [DEBUG   ] Got command BAM from MCS: ref #670338
2018-11-29 22:18:20 [INFO    ] Finished processing BAM request
2018-11-29 22:18:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670338   8 58451 80300033 A  ERROR'
2018-11-29 22:18:20 [DEBUG   ] Got command BAM from MCS: ref #670337
2018-11-29 22:18:20 [INFO    ] Finished processing BAM request
2018-11-29 22:18:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670337   8 58451 80300041 A  ERROR'
2018-11-29 22:18:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:18:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:18:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:18:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:18:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:18:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:18:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:18:20 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:18:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:18:20 [DEBUG   ] spawn_process: at 2018-11-29 22:18:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:18:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:18:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:19:03 [DEBUG   ] Got command RPT from MCS: ref #670339
2018-11-29 22:19:03 [DEBUG   ] summary = ERROR
2018-11-29 22:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670339  13 58451 80343133 A  ERRORERROR'
2018-11-29 22:19:03 [DEBUG   ] Got command RPT from MCS: ref #670340
2018-11-29 22:19:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670340  77 58451 80343337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:19:03 [DEBUG   ] Got command RPT from MCS: ref #670341
2018-11-29 22:19:03 [DEBUG   ] summary = ERROR
2018-11-29 22:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670341  13 58451 80343541 A  ERRORERROR'
2018-11-29 22:19:03 [DEBUG   ] Got command RPT from MCS: ref #670342
2018-11-29 22:19:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670342  77 58451 80343745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:19:03 [DEBUG   ] Got command RPT from MCS: ref #670343
2018-11-29 22:19:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670343  12 58451 80343937 A  ERRORB£ff'
2018-11-29 22:19:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:19:08 [DEBUG   ] Got command BAM from MCS: ref #670344
2018-11-29 22:19:08 [INFO    ] Finished processing BAM request
2018-11-29 22:19:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670344   8 58451 80348033 A  ERROR'
2018-11-29 22:19:08 [DEBUG   ] Got command BAM from MCS: ref #670345
2018-11-29 22:19:08 [INFO    ] Finished processing BAM request
2018-11-29 22:19:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670345   8 58451 80348037 A  ERROR'
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:19:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:19:08 [DEBUG   ] spawn_process: at 2018-11-29 22:19:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 22:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:19:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:19:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 22:19:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:19:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:19:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:19:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:19:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:19:20 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-11-29 22:19:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:19:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:19:56 [DEBUG   ] Got command BAM from MCS: ref #670347
2018-11-29 22:19:56 [INFO    ] Finished processing BAM request
2018-11-29 22:19:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670347   8 58451 80396025 A  ERROR'
2018-11-29 22:19:56 [DEBUG   ] Got command BAM from MCS: ref #670346
2018-11-29 22:19:56 [INFO    ] Finished processing BAM request
2018-11-29 22:19:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670346   8 58451 80396029 A  ERROR'
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 22:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 22:19:56 [DEBUG   ] spawn_process: at 2018-11-29 22:19:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 22:20:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 22:20:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:20:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 22:20:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:20:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:20:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:20:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:20:21 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-11-29 22:20:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:20:44 [DEBUG   ] Got command BAM from MCS: ref #670353
2018-11-29 22:20:44 [INFO    ] Finished processing BAM request
2018-11-29 22:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670353   8 58451 80444033 A  ERROR'
2018-11-29 22:20:44 [DEBUG   ] Got command BAM from MCS: ref #670352
2018-11-29 22:20:44 [INFO    ] Finished processing BAM request
2018-11-29 22:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670352   8 58451 80444037 A  ERROR'
2018-11-29 22:20:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:20:44 [DEBUG   ] spawn_process: at 2018-11-29 22:20:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:20:49 [DEBUG   ] Got command RPT from MCS: ref #670354
2018-11-29 22:20:49 [DEBUG   ] summary = ERROR
2018-11-29 22:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670354  13 58451 80449813 A  ERRORERROR'
2018-11-29 22:20:49 [DEBUG   ] Got command RPT from MCS: ref #670355
2018-11-29 22:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670355  77 58451 80449814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:21:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 22:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 22:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:21:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:21:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:21:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:21:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:21:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:21:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:21:20 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-29 22:21:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:21:32 [DEBUG   ] Got command BAM from MCS: ref #670371
2018-11-29 22:21:32 [INFO    ] Finished processing BAM request
2018-11-29 22:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670371   8 58451 80492025 A  ERROR'
2018-11-29 22:21:32 [DEBUG   ] Got command BAM from MCS: ref #670372
2018-11-29 22:21:32 [INFO    ] Finished processing BAM request
2018-11-29 22:21:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670372   8 58451 80492029 A  ERROR'
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:21:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:21:32 [DEBUG   ] spawn_process: at 2018-11-29 22:21:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:21:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:22:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:22:20 [DEBUG   ] Got command BAM from MCS: ref #670373
2018-11-29 22:22:20 [INFO    ] Finished processing BAM request
2018-11-29 22:22:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670373   8 58451 80540033 A  ERROR'
2018-11-29 22:22:20 [DEBUG   ] Got command BAM from MCS: ref #670374
2018-11-29 22:22:20 [INFO    ] Finished processing BAM request
2018-11-29 22:22:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670374   8 58451 80540037 A  ERROR'
2018-11-29 22:22:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:22:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:22:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:22:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:22:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:22:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:22:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:22:20 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:22:20 [DEBUG   ] spawn_process: at 2018-11-29 22:22:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:22:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:22:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:23:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:23:08 [DEBUG   ] Got command BAM from MCS: ref #670375
2018-11-29 22:23:08 [INFO    ] Finished processing BAM request
2018-11-29 22:23:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670375   8 58451 80588029 A  ERROR'
2018-11-29 22:23:08 [DEBUG   ] Got command BAM from MCS: ref #670376
2018-11-29 22:23:08 [INFO    ] Finished processing BAM request
2018-11-29 22:23:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670376   8 58451 80588033 A  ERROR'
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:23:08 [DEBUG   ] spawn_process: at 2018-11-29 22:23:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:23:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:23:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 22:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:23:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:23:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:23:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:23:20 [WARNING ] (13, 1, 'bot')
2018-11-29 22:23:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:23:20 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-29 22:23:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:23:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:23:56 [DEBUG   ] Got command BAM from MCS: ref #670383
2018-11-29 22:23:56 [INFO    ] Finished processing BAM request
2018-11-29 22:23:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670383   8 58451 80636025 A  ERROR'
2018-11-29 22:23:56 [DEBUG   ] Got command BAM from MCS: ref #670384
2018-11-29 22:23:56 [INFO    ] Finished processing BAM request
2018-11-29 22:23:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670384   8 58451 80636029 A  ERROR'
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:23:56 [DEBUG   ] spawn_process: at 2018-11-29 22:23:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:24:03 [DEBUG   ] Got command RPT from MCS: ref #670385
2018-11-29 22:24:03 [DEBUG   ] summary = ERROR
2018-11-29 22:24:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670385  13 58451 80643229 A  ERRORERROR'
2018-11-29 22:24:03 [DEBUG   ] Got command RPT from MCS: ref #670386
2018-11-29 22:24:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:24:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670386  77 58451 80643421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:24:03 [DEBUG   ] Got command RPT from MCS: ref #670387
2018-11-29 22:24:03 [DEBUG   ] summary = ERROR
2018-11-29 22:24:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670387  13 58451 80643625 A  ERRORERROR'
2018-11-29 22:24:03 [DEBUG   ] Got command RPT from MCS: ref #670388
2018-11-29 22:24:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:24:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670388  77 58451 80643829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:24:04 [DEBUG   ] Got command RPT from MCS: ref #670390
2018-11-29 22:24:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670390  12 58451 80644033 A  ERRORB£ff'
2018-11-29 22:24:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:24:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:24:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:24:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:24:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:24:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:24:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:24:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:24:21 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-11-29 22:24:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:24:44 [DEBUG   ] Got command BAM from MCS: ref #670396
2018-11-29 22:24:44 [INFO    ] Finished processing BAM request
2018-11-29 22:24:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670396   8 58451 80684029 A  ERROR'
2018-11-29 22:24:44 [DEBUG   ] Got command BAM from MCS: ref #670395
2018-11-29 22:24:44 [INFO    ] Finished processing BAM request
2018-11-29 22:24:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670395   8 58451 80684033 A  ERROR'
2018-11-29 22:24:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:24:44 [DEBUG   ] spawn_process: at 2018-11-29 22:24:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:25:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:25:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 22:25:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:25:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:25:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:25:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:25:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:25:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:25:21 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-11-29 22:25:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:25:32 [DEBUG   ] Got command BAM from MCS: ref #670397
2018-11-29 22:25:32 [INFO    ] Finished processing BAM request
2018-11-29 22:25:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670397   8 58451 80732033 A  ERROR'
2018-11-29 22:25:32 [DEBUG   ] Got command BAM from MCS: ref #670398
2018-11-29 22:25:32 [INFO    ] Finished processing BAM request
2018-11-29 22:25:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670398   8 58451 80732037 A  ERROR'
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:25:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:25:32 [DEBUG   ] spawn_process: at 2018-11-29 22:25:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:25:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:25:49 [DEBUG   ] Got command RPT from MCS: ref #670399
2018-11-29 22:25:49 [DEBUG   ] summary = ERROR
2018-11-29 22:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670399  13 58451 80749813 A  ERRORERROR'
2018-11-29 22:25:49 [DEBUG   ] Got command RPT from MCS: ref #670400
2018-11-29 22:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670400  77 58451 80749814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:26:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:26:20 [DEBUG   ] Got command BAM from MCS: ref #670421
2018-11-29 22:26:20 [INFO    ] Finished processing BAM request
2018-11-29 22:26:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670421   8 58451 80780033 A  ERROR'
2018-11-29 22:26:20 [DEBUG   ] Got command BAM from MCS: ref #670420
2018-11-29 22:26:20 [INFO    ] Finished processing BAM request
2018-11-29 22:26:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670420   8 58451 80780037 A  ERROR'
2018-11-29 22:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:26:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 22:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 22:26:20 [DEBUG   ] spawn_process: at 2018-11-29 22:26:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 22:26:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:26:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:26:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:26:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:26:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:26:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:26:21 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-29 22:26:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:26:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:27:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:27:08 [DEBUG   ] Got command BAM from MCS: ref #670423
2018-11-29 22:27:08 [INFO    ] Finished processing BAM request
2018-11-29 22:27:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670423   8 58451 80828033 A  ERROR'
2018-11-29 22:27:08 [DEBUG   ] Got command BAM from MCS: ref #670422
2018-11-29 22:27:08 [INFO    ] Finished processing BAM request
2018-11-29 22:27:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:27:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670422   8 58451 80828037 A  ERROR'
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:27:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:27:08 [DEBUG   ] spawn_process: at 2018-11-29 22:27:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:27:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 22:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 22:27:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-29 22:27:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:27:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:27:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:27:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:27:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:27:21 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-11-29 22:27:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:27:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:27:56 [DEBUG   ] Got command BAM from MCS: ref #670425
2018-11-29 22:27:56 [INFO    ] Finished processing BAM request
2018-11-29 22:27:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:27:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670425   8 58451 80876025 A  ERROR'
2018-11-29 22:27:56 [DEBUG   ] Got command BAM from MCS: ref #670424
2018-11-29 22:27:56 [INFO    ] Finished processing BAM request
2018-11-29 22:27:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:27:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670424   8 58451 80876029 A  ERROR'
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:27:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:27:56 [DEBUG   ] spawn_process: at 2018-11-29 22:27:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:28:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 22:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:28:22 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:28:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:28:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:28:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:28:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:28:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:28:22 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-11-29 22:28:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:28:44 [DEBUG   ] Got command BAM from MCS: ref #670426
2018-11-29 22:28:44 [INFO    ] Finished processing BAM request
2018-11-29 22:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670426   8 58451 80924025 A  ERROR'
2018-11-29 22:28:44 [DEBUG   ] Got command BAM from MCS: ref #670427
2018-11-29 22:28:44 [INFO    ] Finished processing BAM request
2018-11-29 22:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670427   8 58451 80924029 A  ERROR'
2018-11-29 22:28:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 22:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 22:28:44 [DEBUG   ] spawn_process: at 2018-11-29 22:28:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 22:29:03 [DEBUG   ] Got command RPT from MCS: ref #670428
2018-11-29 22:29:03 [DEBUG   ] summary = ERROR
2018-11-29 22:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670428  13 58451 80943313 A  ERRORERROR'
2018-11-29 22:29:03 [DEBUG   ] Got command RPT from MCS: ref #670429
2018-11-29 22:29:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670429  77 58451 80943505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:29:03 [DEBUG   ] Got command RPT from MCS: ref #670430
2018-11-29 22:29:03 [DEBUG   ] summary = ERROR
2018-11-29 22:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670430  13 58451 80943717 A  ERRORERROR'
2018-11-29 22:29:03 [DEBUG   ] Got command RPT from MCS: ref #670431
2018-11-29 22:29:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670431  77 58451 80943909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:29:04 [DEBUG   ] Got command RPT from MCS: ref #670432
2018-11-29 22:29:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670432  12 58451 80944113 A  ERRORB¢ff'
2018-11-29 22:29:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:29:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:29:22 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:29:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:29:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:29:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:29:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:29:22 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-29 22:29:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:29:32 [DEBUG   ] Got command BAM from MCS: ref #670437
2018-11-29 22:29:32 [INFO    ] Finished processing BAM request
2018-11-29 22:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670437   8 58451 80972025 A  ERROR'
2018-11-29 22:29:32 [DEBUG   ] Got command BAM from MCS: ref #670438
2018-11-29 22:29:32 [INFO    ] Finished processing BAM request
2018-11-29 22:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670438   8 58451 80972029 A  ERROR'
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 22:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 22:29:32 [DEBUG   ] spawn_process: at 2018-11-29 22:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 22:29:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:30:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:30:20 [DEBUG   ] Got command BAM from MCS: ref #670439
2018-11-29 22:30:20 [INFO    ] Finished processing BAM request
2018-11-29 22:30:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670439   8 58451 81020029 A  ERROR'
2018-11-29 22:30:20 [DEBUG   ] Got command BAM from MCS: ref #670440
2018-11-29 22:30:20 [INFO    ] Finished processing BAM request
2018-11-29 22:30:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670440   8 58451 81020033 A  ERROR'
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:30:20 [DEBUG   ] spawn_process: at 2018-11-29 22:30:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:30:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:30:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:30:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:30:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:30:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:30:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:30:21 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-29 22:30:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:30:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:30:49 [DEBUG   ] Got command RPT from MCS: ref #670441
2018-11-29 22:30:49 [DEBUG   ] summary = ERROR
2018-11-29 22:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670441  13 58451 81049813 A  ERRORERROR'
2018-11-29 22:30:49 [DEBUG   ] Got command RPT from MCS: ref #670442
2018-11-29 22:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670442  77 58451 81049814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:31:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:31:08 [DEBUG   ] Got command BAM from MCS: ref #670458
2018-11-29 22:31:08 [INFO    ] Finished processing BAM request
2018-11-29 22:31:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670458   8 58451 81068033 A  ERROR'
2018-11-29 22:31:08 [DEBUG   ] Got command BAM from MCS: ref #670459
2018-11-29 22:31:08 [INFO    ] Finished processing BAM request
2018-11-29 22:31:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670459   8 58451 81068037 A  ERROR'
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:31:08 [DEBUG   ] spawn_process: at 2018-11-29 22:31:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 22:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 22:31:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:31:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:31:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:31:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:31:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:31:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:31:21 [DEBUG   ] Finished updating board flags in 1.236 seconds
2018-11-29 22:31:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:31:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:31:56 [DEBUG   ] Got command BAM from MCS: ref #670461
2018-11-29 22:31:56 [INFO    ] Finished processing BAM request
2018-11-29 22:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670461   8 58451 81116029 A  ERROR'
2018-11-29 22:31:56 [DEBUG   ] Got command BAM from MCS: ref #670460
2018-11-29 22:31:56 [INFO    ] Finished processing BAM request
2018-11-29 22:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670460   8 58451 81116033 A  ERROR'
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:31:56 [DEBUG   ] spawn_process: at 2018-11-29 22:31:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:32:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 22:32:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:32:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 22:32:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:32:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:32:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:32:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:32:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:32:21 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-11-29 22:32:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:32:44 [DEBUG   ] Got command BAM from MCS: ref #670466
2018-11-29 22:32:44 [INFO    ] Finished processing BAM request
2018-11-29 22:32:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:32:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670466   8 58451 81164025 A  ERROR'
2018-11-29 22:32:44 [DEBUG   ] Got command BAM from MCS: ref #670467
2018-11-29 22:32:44 [INFO    ] Finished processing BAM request
2018-11-29 22:32:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:32:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670467   8 58451 81164029 A  ERROR'
2018-11-29 22:32:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 22:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 22:32:44 [DEBUG   ] spawn_process: at 2018-11-29 22:32:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 22:33:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:33:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:33:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:33:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:33:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:33:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:33:21 [DEBUG   ] Finished updating board flags in 1.159 seconds
2018-11-29 22:33:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 22:33:33 [DEBUG   ] Got command BAM from MCS: ref #670469
2018-11-29 22:33:33 [INFO    ] Finished processing BAM request
2018-11-29 22:33:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670469   8 58451 81213025 A  ERROR'
2018-11-29 22:33:33 [DEBUG   ] Got command BAM from MCS: ref #670468
2018-11-29 22:33:33 [INFO    ] Finished processing BAM request
2018-11-29 22:33:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670468   8 58451 81213029 A  ERROR'
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 22:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 22:33:33 [DEBUG   ] spawn_process: at 2018-11-29 22:33:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 22:33:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:34:03 [DEBUG   ] Got command RPT from MCS: ref #670472
2018-11-29 22:34:03 [DEBUG   ] summary = ERROR
2018-11-29 22:34:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670472  13 58451 81243401 A  ERRORERROR'
2018-11-29 22:34:03 [DEBUG   ] Got command RPT from MCS: ref #670473
2018-11-29 22:34:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:34:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670473  77 58451 81243593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:34:03 [DEBUG   ] Got command RPT from MCS: ref #670474
2018-11-29 22:34:03 [DEBUG   ] summary = ERROR
2018-11-29 22:34:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670474  13 58451 81243797 A  ERRORERROR'
2018-11-29 22:34:04 [DEBUG   ] Got command RPT from MCS: ref #670476
2018-11-29 22:34:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670476  77 58451 81244001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:34:04 [DEBUG   ] Got command RPT from MCS: ref #670478
2018-11-29 22:34:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670478  12 58451 81244205 A  ERRORB¢ff'
2018-11-29 22:34:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 22:34:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 22:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:34:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:34:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:34:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:34:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:34:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:34:21 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-29 22:34:22 [DEBUG   ] Got command BAM from MCS: ref #670482
2018-11-29 22:34:22 [INFO    ] Finished processing BAM request
2018-11-29 22:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670482   8 58451 81262033 A  ERROR'
2018-11-29 22:34:22 [DEBUG   ] Got command BAM from MCS: ref #670483
2018-11-29 22:34:22 [INFO    ] Finished processing BAM request
2018-11-29 22:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670483   8 58451 81262037 A  ERROR'
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:34:22 [DEBUG   ] spawn_process: at 2018-11-29 22:34:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:34:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 22:34:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:35:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:35:11 [DEBUG   ] Got command BAM from MCS: ref #670485
2018-11-29 22:35:11 [INFO    ] Finished processing BAM request
2018-11-29 22:35:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670485   8 58451 81311033 A  ERROR'
2018-11-29 22:35:11 [DEBUG   ] Got command BAM from MCS: ref #670484
2018-11-29 22:35:11 [INFO    ] Finished processing BAM request
2018-11-29 22:35:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670484   8 58451 81311037 A  ERROR'
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 22:35:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 22:35:11 [DEBUG   ] spawn_process: at 2018-11-29 22:35:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 22:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 22:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:35:21 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:35:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:35:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:35:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:35:21 [WARNING ] (13, 1, 'bot')
2018-11-29 22:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:35:21 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-11-29 22:35:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:35:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:35:49 [DEBUG   ] Got command RPT from MCS: ref #670490
2018-11-29 22:35:49 [DEBUG   ] summary = ERROR
2018-11-29 22:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670490  13 58451 81349825 A  ERRORERROR'
2018-11-29 22:35:49 [DEBUG   ] Got command RPT from MCS: ref #670491
2018-11-29 22:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670491  77 58451 81349826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:36:00 [DEBUG   ] Got command BAM from MCS: ref #670507
2018-11-29 22:36:00 [INFO    ] Finished processing BAM request
2018-11-29 22:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670507   8 58451 81360029 A  ERROR'
2018-11-29 22:36:00 [DEBUG   ] Got command BAM from MCS: ref #670508
2018-11-29 22:36:00 [INFO    ] Finished processing BAM request
2018-11-29 22:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670508   8 58451 81360033 A  ERROR'
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 22:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 22:36:00 [DEBUG   ] spawn_process: at 2018-11-29 22:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 22:36:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:36:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 22:36:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 22:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:36:22 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 22:36:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:36:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:36:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:36:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:36:22 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-29 22:36:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:36:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:36:49 [DEBUG   ] Got command BAM from MCS: ref #670509
2018-11-29 22:36:49 [INFO    ] Finished processing BAM request
2018-11-29 22:36:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670509   8 58451 81409029 A  ERROR'
2018-11-29 22:36:49 [DEBUG   ] Got command BAM from MCS: ref #670510
2018-11-29 22:36:49 [INFO    ] Finished processing BAM request
2018-11-29 22:36:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 22:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670510   8 58451 81409033 A  ERROR'
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 22:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 22:36:49 [DEBUG   ] spawn_process: at 2018-11-29 22:36:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 22:37:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 22:37:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:37:22 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 22:37:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:37:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:37:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:37:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:37:22 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-29 22:37:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:37:26 [DEBUG   ] Got command STP from MCS: ref #670511
2018-11-29 22:37:26 [INFO    ] Finished processing BAM request
2018-11-29 22:37:26 [INFO    ] Shutdown the adder chain on beam #3
2018-11-29 22:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   670511   8 58451 81446117 A  ERROR'
2018-11-29 22:37:26 [DEBUG   ] Got command STP from MCS: ref #670512
2018-11-29 22:37:26 [INFO    ] Finished processing BAM request
2018-11-29 22:37:26 [INFO    ] Shutdown the adder chain on beam #2
2018-11-29 22:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   670512   8 58451 81446121 A  ERROR'
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 22:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 22:37:26 [DEBUG   ] spawn_process: at 2018-11-29 22:37:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 22:37:44 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-29 22:38:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 22:38:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:38:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:38:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:38:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:38:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:38:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:38:22 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-29 22:38:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 22:38:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 22:39:03 [DEBUG   ] Got command RPT from MCS: ref #670517
2018-11-29 22:39:03 [DEBUG   ] summary = ERROR
2018-11-29 22:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670517  13 58451 81543481 A  ERRORERROR'
2018-11-29 22:39:03 [DEBUG   ] Got command RPT from MCS: ref #670518
2018-11-29 22:39:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670518  77 58451 81543685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:39:03 [DEBUG   ] Got command RPT from MCS: ref #670519
2018-11-29 22:39:03 [DEBUG   ] summary = ERROR
2018-11-29 22:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670519  13 58451 81543889 A  ERRORERROR'
2018-11-29 22:39:04 [DEBUG   ] Got command RPT from MCS: ref #670520
2018-11-29 22:39:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670520  77 58451 81544084 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:39:04 [DEBUG   ] Got command RPT from MCS: ref #670521
2018-11-29 22:39:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670521  12 58451 81544289 A  ERRORB�ff'
2018-11-29 22:39:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 22:39:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:39:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:39:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:39:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:39:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:39:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:39:22 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-29 22:39:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 22:39:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 22:40:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 22:40:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:40:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 22:40:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:40:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:40:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:40:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:40:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:40:22 [DEBUG   ] Finished updating board flags in 0.982 seconds
2018-11-29 22:40:25 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-29 22:40:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:40:49 [DEBUG   ] Got command RPT from MCS: ref #670522
2018-11-29 22:40:49 [DEBUG   ] summary = ERROR
2018-11-29 22:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670522  13 58451 81649821 A  ERRORERROR'
2018-11-29 22:40:49 [DEBUG   ] Got command RPT from MCS: ref #670523
2018-11-29 22:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670523  77 58451 81649822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:41:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:41:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 22:41:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:41:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:41:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:41:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:41:23 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-29 22:41:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:41:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:42:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:42:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 22:42:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:42:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:42:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:42:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:42:23 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-29 22:42:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:42:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:43:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:43:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:43:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 22:43:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:43:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:43:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:43:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:43:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:43:23 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-11-29 22:43:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:43:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:44:03 [DEBUG   ] Got command RPT from MCS: ref #670545
2018-11-29 22:44:03 [DEBUG   ] summary = ERROR
2018-11-29 22:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670545  13 58451 81843565 A  ERRORERROR'
2018-11-29 22:44:03 [DEBUG   ] Got command RPT from MCS: ref #670546
2018-11-29 22:44:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670546  77 58451 81843769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:44:03 [DEBUG   ] Got command RPT from MCS: ref #670547
2018-11-29 22:44:03 [DEBUG   ] summary = ERROR
2018-11-29 22:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670547  13 58451 81843973 A  ERRORERROR'
2018-11-29 22:44:04 [DEBUG   ] Got command RPT from MCS: ref #670549
2018-11-29 22:44:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:44:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670549  77 58451 81844177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:44:04 [DEBUG   ] Got command RPT from MCS: ref #670550
2018-11-29 22:44:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:44:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670550  12 58451 81844369 A  ERRORBš™š'
2018-11-29 22:44:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:44:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:44:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:44:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:44:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:44:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:44:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:44:22 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-11-29 22:44:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:44:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:45:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:45:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:45:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:45:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 22:45:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:45:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:45:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:45:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:45:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:45:23 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-11-29 22:45:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:45:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:45:49 [DEBUG   ] Got command RPT from MCS: ref #670559
2018-11-29 22:45:49 [DEBUG   ] summary = ERROR
2018-11-29 22:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670559  13 58451 81949825 A  ERRORERROR'
2018-11-29 22:45:49 [DEBUG   ] Got command RPT from MCS: ref #670560
2018-11-29 22:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670560  77 58451 81949826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:46:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:46:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:46:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:46:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:46:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:46:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:46:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:46:22 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-29 22:46:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:46:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:47:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:47:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:47:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:47:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:47:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:47:22 [WARNING ] (13, 1, 'bot')
2018-11-29 22:47:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:47:22 [DEBUG   ] Finished updating board flags in 1.025 seconds
2018-11-29 22:47:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:47:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:48:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:48:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 22:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 22:48:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:48:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:48:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:48:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:48:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:48:23 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-29 22:48:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:48:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:49:03 [DEBUG   ] Got command RPT from MCS: ref #670580
2018-11-29 22:49:03 [DEBUG   ] summary = ERROR
2018-11-29 22:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670580  13 58451 82143653 A  ERRORERROR'
2018-11-29 22:49:03 [DEBUG   ] Got command RPT from MCS: ref #670581
2018-11-29 22:49:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670581  77 58451 82143857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:49:04 [DEBUG   ] Got command RPT from MCS: ref #670582
2018-11-29 22:49:04 [DEBUG   ] summary = ERROR
2018-11-29 22:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670582  13 58451 82144061 A  ERRORERROR'
2018-11-29 22:49:04 [DEBUG   ] Got command RPT from MCS: ref #670583
2018-11-29 22:49:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670583  77 58451 82144254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:49:04 [DEBUG   ] Got command RPT from MCS: ref #670584
2018-11-29 22:49:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670584  12 58451 82144458 A  ERRORB™™š'
2018-11-29 22:49:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:49:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:49:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:49:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:49:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:49:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:49:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:49:23 [DEBUG   ] Finished updating board flags in 1.339 seconds
2018-11-29 22:49:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:49:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:50:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:50:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:50:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:50:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 22:50:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:50:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:50:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:50:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:50:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:50:23 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-11-29 22:50:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:50:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:50:49 [DEBUG   ] Got command RPT from MCS: ref #670589
2018-11-29 22:50:49 [DEBUG   ] summary = ERROR
2018-11-29 22:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670589  13 58451 82249821 A  ERRORERROR'
2018-11-29 22:50:49 [DEBUG   ] Got command RPT from MCS: ref #670590
2018-11-29 22:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670590  77 58451 82249822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:51:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:51:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:51:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 22:51:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:51:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:51:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:51:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:51:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:51:23 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-29 22:51:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:51:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:52:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:52:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:52:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:52:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 22:52:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:52:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:52:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:52:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:52:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:52:23 [DEBUG   ] Finished updating board flags in 1.156 seconds
2018-11-29 22:52:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 22:52:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:53:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:53:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:53:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:53:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:53:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:53:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:53:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:53:23 [DEBUG   ] Finished updating board flags in 1.056 seconds
2018-11-29 22:53:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:53:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:54:03 [DEBUG   ] Got command RPT from MCS: ref #670612
2018-11-29 22:54:03 [DEBUG   ] summary = ERROR
2018-11-29 22:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670612  13 58451 82443737 A  ERRORERROR'
2018-11-29 22:54:03 [DEBUG   ] Got command RPT from MCS: ref #670613
2018-11-29 22:54:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670613  77 58451 82443941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:54:04 [DEBUG   ] Got command RPT from MCS: ref #670614
2018-11-29 22:54:04 [DEBUG   ] summary = ERROR
2018-11-29 22:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670614  13 58451 82444145 A  ERRORERROR'
2018-11-29 22:54:04 [DEBUG   ] Got command RPT from MCS: ref #670616
2018-11-29 22:54:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670616  77 58451 82444349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:54:04 [DEBUG   ] Got command RPT from MCS: ref #670617
2018-11-29 22:54:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670617  12 58451 82444541 A  ERRORB™™š'
2018-11-29 22:54:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 22:54:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:54:24 [WARNING ] (13, 1, 'bot')
2018-11-29 22:54:24 [WARNING ] (13, 1, 'bot')
2018-11-29 22:54:24 [WARNING ] (13, 1, 'bot')
2018-11-29 22:54:24 [WARNING ] (13, 1, 'bot')
2018-11-29 22:54:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:54:24 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-11-29 22:54:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-29 22:54:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:55:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:55:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 22:55:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:55:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:55:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:55:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:55:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:55:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:55:23 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-11-29 22:55:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:55:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:55:49 [DEBUG   ] Got command RPT from MCS: ref #670622
2018-11-29 22:55:49 [DEBUG   ] summary = ERROR
2018-11-29 22:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670622  13 58451 82549829 A  ERRORERROR'
2018-11-29 22:55:49 [DEBUG   ] Got command RPT from MCS: ref #670623
2018-11-29 22:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670623  77 58451 82549830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:56:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:56:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:56:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 22:56:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:56:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:56:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:56:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:56:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:56:23 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-11-29 22:56:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 22:56:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:57:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 22:57:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:57:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:57:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:57:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:57:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:57:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:57:23 [DEBUG   ] Finished updating board flags in 1.233 seconds
2018-11-29 22:57:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 22:57:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:58:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:58:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 22:58:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:58:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:58:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:58:23 [WARNING ] (13, 1, 'bot')
2018-11-29 22:58:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 22:58:23 [DEBUG   ] Finished updating board flags in 1.146 seconds
2018-11-29 22:58:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 22:58:46 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-29 22:59:00 [DEBUG   ] Got command RPT from MCS: ref #670643
2018-11-29 22:59:00 [DEBUG   ] summary = ERROR
2018-11-29 22:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670643  13 58451 82740653 A  ERRORERROR'
2018-11-29 22:59:00 [DEBUG   ] Got command RPT from MCS: ref #670644
2018-11-29 22:59:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670644  77 58451 82740654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:59:03 [DEBUG   ] Got command RPT from MCS: ref #670645
2018-11-29 22:59:03 [DEBUG   ] summary = ERROR
2018-11-29 22:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670645  13 58451 82743833 A  ERRORERROR'
2018-11-29 22:59:04 [DEBUG   ] Got command RPT from MCS: ref #670646
2018-11-29 22:59:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670646  77 58451 82744025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:59:04 [DEBUG   ] Got command RPT from MCS: ref #670647
2018-11-29 22:59:04 [DEBUG   ] summary = ERROR
2018-11-29 22:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670647  13 58451 82744229 A  ERRORERROR'
2018-11-29 22:59:04 [DEBUG   ] Got command RPT from MCS: ref #670648
2018-11-29 22:59:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 22:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670648  77 58451 82744433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 22:59:04 [DEBUG   ] Got command RPT from MCS: ref #670649
2018-11-29 22:59:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 22:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670649  12 58451 82744637 A  ERRORB˜™š'
2018-11-29 22:59:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 22:59:05 [DEBUG   ] Got command INI from MCS: ref #670650
2018-11-29 22:59:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-29 22:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   670650   8 58451 82745662 ABOOTING'
2018-11-29 22:59:26 [INFO    ] -------------------
2018-11-29 22:59:26 [INFO    ]  LWA board status
2018-11-29 22:59:26 [INFO    ] -------------------
2018-11-29 22:59:26 [INFO    ] DP 1: 2 lwa27
2018-11-29 22:59:26 [INFO    ] DP 1: 3 lwa24
2018-11-29 22:59:26 [INFO    ] DP 1: 4 lwa23
2018-11-29 22:59:26 [INFO    ] DP 1: 5 lwa18
2018-11-29 22:59:26 [INFO    ] DP 1: 6 lwa10
2018-11-29 22:59:26 [INFO    ] DP 1: 7 lwa32
2018-11-29 22:59:26 [INFO    ] DP 1: 8 lwa11
2018-11-29 22:59:26 [INFO    ] DP 1: 9 lwa30
2018-11-29 22:59:26 [INFO    ] DP 1: 10 lwa12
2018-11-29 22:59:26 [INFO    ] DP 1: 11 lwa8
2018-11-29 22:59:26 [INFO    ] DP 1: 12 lwa13
2018-11-29 22:59:26 [INFO    ] DP 1: 13 lwa26
2018-11-29 22:59:26 [INFO    ] DP 1: 14 lwa14
2018-11-29 22:59:26 [INFO    ] DP 1: 16 lwa22
2018-11-29 22:59:26 [INFO    ] DP 1: 17 lwa20
2018-11-29 22:59:26 [INFO    ] DP 1: 18 lwa1
2018-11-29 22:59:26 [INFO    ] DP 1: 19 lwa5
2018-11-29 22:59:26 [INFO    ] DP 1: 20 lwa25
2018-11-29 22:59:26 [INFO    ] DP 1: 21 lwa35
2018-11-29 22:59:26 [INFO    ] DP 1: 22 lwa19
2018-11-29 22:59:26 [INFO    ] DP 1: 23 lwa21
2018-11-29 22:59:26 [INFO    ] DP 1: 24 lwa6
2018-11-29 22:59:26 [INFO    ] DP 1: 25 lwa7
2018-11-29 22:59:26 [INFO    ] DP 1: 26 lwa33
2018-11-29 22:59:26 [INFO    ] DP 1: 27 lwa15
2018-11-29 22:59:26 [INFO    ] DP 1: 28 lwa28
2018-11-29 22:59:26 [INFO    ] DP 2: 1 lwa16
2018-11-29 22:59:26 [INFO    ] DP 2: 15 lwa34
2018-11-29 22:59:26 [INFO    ] Total of 28 boards
2018-11-29 22:59:26 [INFO    ] Total of 260 stands
2018-11-29 22:59:26 [INFO    ] -------------------
2018-11-29 22:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6602
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6603
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6604
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6605
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6606
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6607
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6608
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6609
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6610
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6611
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6612
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6613
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6614
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6615
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6616
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6617
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6618
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6619
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6620
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6621
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6622
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6623
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6624
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6625
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6626
2018-11-29 22:59:33 [DEBUG   ] 2018-11-29 22:59:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6627
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6602 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6603 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6604 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6605 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6606 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6607 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6608 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6609 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6610 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6611 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6612 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6613 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6614 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6615 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6616 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6617 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6618 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6619 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6620 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6621 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6622 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6623 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6624 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6625 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6626 exited with status 0
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6627 exited with status 0
2018-11-29 22:59:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] spawn_process: at 2018-11-29 22:59:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6654
2018-11-29 22:59:45 [DEBUG   ] 2018-11-29 22:59:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6655
2018-11-29 22:59:51 [DEBUG   ] 2018-11-29 22:59:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6654 exited with status 0
2018-11-29 22:59:51 [DEBUG   ] 2018-11-29 22:59:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6655 exited with status 0
2018-11-29 22:59:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-29 22:59:51 [DEBUG   ] spawn_process: at 2018-11-29 22:59:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-29 22:59:51 [DEBUG   ] spawn_process: at 2018-11-29 22:59:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-29 22:59:51 [INFO    ] Setting Beam 1 xbars
2018-11-29 22:59:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-29 22:59:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-29 22:59:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-29 22:59:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-29 22:59:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-29 22:59:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-29 22:59:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-29 22:59:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-29 22:59:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-29 22:59:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-29 22:59:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-29 22:59:56 [INFO    ] Setting Beam 2 xbars
2018-11-29 22:59:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-29 22:59:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-29 22:59:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-29 22:59:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-29 23:00:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-29 23:00:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-29 23:00:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-29 23:00:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-29 23:00:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-29 23:00:02 [INFO    ] Setting Beam 3 xbars
2018-11-29 23:00:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-29 23:00:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-29 23:00:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-29 23:00:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-29 23:00:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-29 23:00:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-29 23:00:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-29 23:00:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-29 23:00:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-29 23:00:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-29 23:00:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-29 23:00:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-29 23:00:07 [INFO    ] Setting Beam 4 xbars
2018-11-29 23:00:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-29 23:00:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-29 23:00:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-29 23:00:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-29 23:00:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-29 23:00:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-29 23:00:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-29 23:00:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-29 23:00:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-29 23:00:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-29 23:00:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-29 23:00:13 [INFO    ] All xbars set
2018-11-29 23:00:13 [INFO    ] Setting adder chain routing for all beams
2018-11-29 23:00:18 [INFO    ] Setting beam ids
2018-11-29 23:00:28 [INFO    ] Starting beam delay calibration
2018-11-29 23:00:40 [INFO    ] Beam 1 latency is 5717
2018-11-29 23:00:40 [INFO    ] Beam 2 latency is 5759
2018-11-29 23:00:40 [INFO    ] Beam 3 latency is 5728
2018-11-29 23:00:40 [INFO    ] Beam 4 latency is 5712
2018-11-29 23:00:40 [INFO    ] Stop calibration
2018-11-29 23:00:48 [INFO    ] Beam delay calibration successful
2018-11-29 23:00:48 [INFO    ] Calibration passed
2018-11-29 23:00:48 [DEBUG   ] spawn_process: at 2018-11-29 23:00:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-29 23:00:48 [DEBUG   ] spawn_process: at 2018-11-29 23:00:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-29 23:00:48 [DEBUG   ] spawn_process: at 2018-11-29 23:00:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-29 23:00:48 [DEBUG   ] spawn_process: at 2018-11-29 23:00:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-29 23:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-29 23:00:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-29 23:00:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 536 ms (1543532448.539 s) with PID 8238 and time 1543532449
2018-11-29 23:00:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-29 23:00:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 293 ms (1543532449.296 s) with PID 8259 and time 1543532450
2018-11-29 23:00:49 [DEBUG   ] Got command RPT from MCS: ref #670655
2018-11-29 23:00:49 [DEBUG   ] summary = BOOTING
2018-11-29 23:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670655  15 58451 82849829 ABOOTINGBOOTING'
2018-11-29 23:00:49 [DEBUG   ] Got command RPT from MCS: ref #670656
2018-11-29 23:00:49 [DEBUG   ] info = Calibration passed
2018-11-29 23:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670656  26 58451 82849830 ABOOTINGCalibration passed'
2018-11-29 23:00:50 [DEBUG   ] Finished updating ant stats in 0.952 seconds
2018-11-29 23:00:50 [INFO    ] Started antennas statistics background thread
2018-11-29 23:00:50 [INFO    ] Started board flags background thread
2018-11-29 23:00:50 [INFO    ] Started BAM background thread
2018-11-29 23:00:50 [INFO    ] Finished the INI process (ref. #670650) in 104.757 s
2018-11-29 23:00:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:00:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:00:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:00:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:00:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:00:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:00:51 [DEBUG   ] Finished updating board flags in 1.143 seconds
2018-11-29 23:01:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 23:01:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:01:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:01:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:01:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:01:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:01:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:01:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:01:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:01:51 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-29 23:02:05 [DEBUG   ] Got command RPT from MCS: ref #670672
2018-11-29 23:02:05 [DEBUG   ] summary = ERROR
2018-11-29 23:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670672  13 58451 82925657 A  ERRORERROR'
2018-11-29 23:02:05 [DEBUG   ] Got command RPT from MCS: ref #670673
2018-11-29 23:02:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670673  77 58451 82925658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:02:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:02:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:02:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:02:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:02:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:02:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:02:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:02:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:02:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:02:52 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-11-29 23:03:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:03:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:03:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:03:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:03:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 23:03:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:03:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:03:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:03:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:03:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:03:51 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-11-29 23:04:03 [DEBUG   ] Got command RPT from MCS: ref #670680
2018-11-29 23:04:03 [DEBUG   ] summary = ERROR
2018-11-29 23:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670680  13 58451 83043913 A  ERRORERROR'
2018-11-29 23:04:04 [DEBUG   ] Got command RPT from MCS: ref #670681
2018-11-29 23:04:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670681  77 58451 83044117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:04:04 [DEBUG   ] Got command RPT from MCS: ref #670682
2018-11-29 23:04:04 [DEBUG   ] summary = ERROR
2018-11-29 23:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670682  13 58451 83044321 A  ERRORERROR'
2018-11-29 23:04:04 [DEBUG   ] Got command RPT from MCS: ref #670684
2018-11-29 23:04:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670684  77 58451 83044525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:04:04 [DEBUG   ] Got command RPT from MCS: ref #670685
2018-11-29 23:04:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670685  12 58451 83044717 A  ERRORB—™š'
2018-11-29 23:04:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:04:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:04:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 23:04:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:04:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:04:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:04:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:04:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:04:51 [WARNING ] (13, 1, 'bot')
2018-11-29 23:04:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:04:51 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-29 23:05:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:05:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:05:49 [DEBUG   ] Got command RPT from MCS: ref #670694
2018-11-29 23:05:49 [DEBUG   ] summary = ERROR
2018-11-29 23:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670694  13 58451 83149825 A  ERRORERROR'
2018-11-29 23:05:49 [DEBUG   ] Got command RPT from MCS: ref #670695
2018-11-29 23:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670695  77 58451 83149826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:05:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-29 23:05:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:05:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:05:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:05:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:05:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:05:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:05:52 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-11-29 23:06:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:06:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:06:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:06:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:06:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:06:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:06:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:06:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:06:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:06:52 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-29 23:07:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:07:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:07:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:07:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:07:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:07:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:07:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:07:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:07:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:07:52 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-29 23:08:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:08:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:08:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:08:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:08:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:08:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:08:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:08:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:08:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:08:52 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-11-29 23:09:04 [DEBUG   ] Got command RPT from MCS: ref #670715
2018-11-29 23:09:04 [DEBUG   ] summary = ERROR
2018-11-29 23:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670715  13 58451 83344001 A  ERRORERROR'
2018-11-29 23:09:04 [DEBUG   ] Got command RPT from MCS: ref #670716
2018-11-29 23:09:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670716  77 58451 83344205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:09:04 [DEBUG   ] Got command RPT from MCS: ref #670717
2018-11-29 23:09:04 [DEBUG   ] summary = ERROR
2018-11-29 23:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670717  13 58451 83344409 A  ERRORERROR'
2018-11-29 23:09:04 [DEBUG   ] Got command RPT from MCS: ref #670718
2018-11-29 23:09:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670718  77 58451 83344601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:09:04 [DEBUG   ] Got command RPT from MCS: ref #670719
2018-11-29 23:09:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670719  12 58451 83344805 A  ERRORB˜™š'
2018-11-29 23:09:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:09:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:09:50 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2018-11-29 23:09:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:09:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 23:09:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:09:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:09:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:09:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:09:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:09:52 [DEBUG   ] Finished updating board flags in 1.311 seconds
2018-11-29 23:10:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:10:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:10:49 [DEBUG   ] Got command RPT from MCS: ref #670720
2018-11-29 23:10:49 [DEBUG   ] summary = ERROR
2018-11-29 23:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670720  13 58451 83449821 A  ERRORERROR'
2018-11-29 23:10:49 [DEBUG   ] Got command RPT from MCS: ref #670721
2018-11-29 23:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670721  77 58451 83449822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:10:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:10:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:10:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:10:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:10:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:10:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:10:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:10:52 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-29 23:11:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:11:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:11:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 23:11:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-29 23:11:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:11:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:11:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:11:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:11:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:11:52 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-29 23:12:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:12:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:12:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:12:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:12:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:12:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 23:12:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:12:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:12:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:12:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:12:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:12:52 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-11-29 23:13:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:13:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:13:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:13:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:13:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:13:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:13:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:13:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:13:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:13:52 [DEBUG   ] Finished updating board flags in 1.069 seconds
2018-11-29 23:14:04 [DEBUG   ] Got command RPT from MCS: ref #670743
2018-11-29 23:14:04 [DEBUG   ] summary = ERROR
2018-11-29 23:14:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670743  13 58451 83644085 A  ERRORERROR'
2018-11-29 23:14:04 [DEBUG   ] Got command RPT from MCS: ref #670744
2018-11-29 23:14:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:14:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670744  77 58451 83644289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:14:04 [DEBUG   ] Got command RPT from MCS: ref #670745
2018-11-29 23:14:04 [DEBUG   ] summary = ERROR
2018-11-29 23:14:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670745  13 58451 83644493 A  ERRORERROR'
2018-11-29 23:14:04 [DEBUG   ] Got command RPT from MCS: ref #670746
2018-11-29 23:14:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:14:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670746  77 58451 83644697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:14:04 [DEBUG   ] Got command RPT from MCS: ref #670748
2018-11-29 23:14:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:14:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670748  12 58451 83644889 A  ERRORBš™š'
2018-11-29 23:14:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:14:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:14:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:14:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:14:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:14:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:14:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:14:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:14:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:14:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:14:53 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-11-29 23:15:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:15:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:15:49 [DEBUG   ] Got command RPT from MCS: ref #670757
2018-11-29 23:15:49 [DEBUG   ] summary = ERROR
2018-11-29 23:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670757  13 58451 83749829 A  ERRORERROR'
2018-11-29 23:15:49 [DEBUG   ] Got command RPT from MCS: ref #670758
2018-11-29 23:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670758  77 58451 83749830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:15:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:15:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:15:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:15:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:15:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:15:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:15:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:15:52 [DEBUG   ] Finished updating board flags in 1.171 seconds
2018-11-29 23:16:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:16:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:16:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:16:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:16:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:16:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:16:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:16:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:16:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:16:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:16:52 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-11-29 23:17:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:17:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:17:50 [DEBUG   ] Finished updating ant stats in 0.503 seconds
2018-11-29 23:17:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 23:17:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:17:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:17:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:17:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:17:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:17:52 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-29 23:18:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:18:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:18:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:18:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:18:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:18:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:18:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:18:52 [WARNING ] (13, 1, 'bot')
2018-11-29 23:18:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:18:52 [DEBUG   ] Finished updating board flags in 0.959 seconds
2018-11-29 23:19:04 [DEBUG   ] Got command RPT from MCS: ref #670778
2018-11-29 23:19:04 [DEBUG   ] summary = ERROR
2018-11-29 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670778  13 58451 83944174 A  ERRORERROR'
2018-11-29 23:19:04 [DEBUG   ] Got command RPT from MCS: ref #670779
2018-11-29 23:19:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670779  77 58451 83944377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:19:04 [DEBUG   ] Got command RPT from MCS: ref #670780
2018-11-29 23:19:04 [DEBUG   ] summary = ERROR
2018-11-29 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670780  13 58451 83944581 A  ERRORERROR'
2018-11-29 23:19:04 [DEBUG   ] Got command RPT from MCS: ref #670781
2018-11-29 23:19:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670781  77 58451 83944774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:19:04 [DEBUG   ] Got command RPT from MCS: ref #670782
2018-11-29 23:19:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670782  12 58451 83944977 A  ERRORB™™š'
2018-11-29 23:19:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:19:14 [DEBUG   ] Got command BAM from MCS: ref #670787
2018-11-29 23:19:14 [INFO    ] Finished processing BAM request
2018-11-29 23:19:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670787   8 58451 83954038 A  ERROR'
2018-11-29 23:19:14 [DEBUG   ] Got command BAM from MCS: ref #670788
2018-11-29 23:19:14 [INFO    ] Finished processing BAM request
2018-11-29 23:19:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670788   8 58451 83954042 A  ERROR'
2018-11-29 23:19:14 [DEBUG   ] Got command DRX from MCS: ref #670789
2018-11-29 23:19:14 [INFO    ] sending drx command to lwa16
2018-11-29 23:19:14 [DEBUG   ] run_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 9']
2018-11-29 23:19:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   670789   8 58451 83954114 A  ERROR'
2018-11-29 23:19:14 [DEBUG   ] Got command DRX from MCS: ref #670790
2018-11-29 23:19:14 [INFO    ] sending drx command to lwa34
2018-11-29 23:19:14 [DEBUG   ] run_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 64500000.0 7 9 9']
2018-11-29 23:19:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   670790   8 58451 83954118 A  ERROR'
2018-11-29 23:19:14 [DEBUG   ] Got command DRX from MCS: ref #670792
2018-11-29 23:19:14 [INFO    ] sending drx command to lwa34
2018-11-29 23:19:14 [DEBUG   ] run_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 79200000.0 7 9 9']
2018-11-29 23:19:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   670792   8 58451 83954122 A  ERROR'
2018-11-29 23:19:14 [DEBUG   ] Got command DRX from MCS: ref #670791
2018-11-29 23:19:14 [INFO    ] sending drx command to lwa16
2018-11-29 23:19:14 [DEBUG   ] run_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 9']
2018-11-29 23:19:14 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-29 23:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   670791   8 58451 83954126 A  ERROR'
2018-11-29 23:19:14 [INFO    ] Finished starting DRX
2018-11-29 23:19:14 [INFO    ] Finished starting DRX
2018-11-29 23:19:14 [INFO    ] Finished starting DRX
2018-11-29 23:19:14 [INFO    ] Finished starting DRX
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:19:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:19:14 [DEBUG   ] spawn_process: at 2018-11-29 23:19:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:19:26 [DEBUG   ] Got command BAM from MCS: ref #670795
2018-11-29 23:19:26 [INFO    ] Finished processing BAM request
2018-11-29 23:19:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670795   8 58451 83966034 A  ERROR'
2018-11-29 23:19:26 [DEBUG   ] Got command BAM from MCS: ref #670796
2018-11-29 23:19:26 [INFO    ] Finished processing BAM request
2018-11-29 23:19:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670796   8 58451 83966038 A  ERROR'
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:19:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:19:26 [DEBUG   ] spawn_process: at 2018-11-29 23:19:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:19:31 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-29 23:19:38 [DEBUG   ] Got command BAM from MCS: ref #670797
2018-11-29 23:19:38 [INFO    ] Finished processing BAM request
2018-11-29 23:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670797   8 58451 83978033 A  ERROR'
2018-11-29 23:19:38 [DEBUG   ] Got command BAM from MCS: ref #670798
2018-11-29 23:19:38 [INFO    ] Finished processing BAM request
2018-11-29 23:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670798   8 58451 83978037 A  ERROR'
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:19:38 [DEBUG   ] spawn_process: at 2018-11-29 23:19:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:19:50 [DEBUG   ] Got command BAM from MCS: ref #670800
2018-11-29 23:19:50 [INFO    ] Finished processing BAM request
2018-11-29 23:19:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670800   8 58451 83990029 A  ERROR'
2018-11-29 23:19:50 [DEBUG   ] Got command BAM from MCS: ref #670799
2018-11-29 23:19:50 [INFO    ] Finished processing BAM request
2018-11-29 23:19:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670799   8 58451 83990033 A  ERROR'
2018-11-29 23:19:50 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:19:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:19:50 [DEBUG   ] spawn_process: at 2018-11-29 23:19:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:19:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:19:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:19:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:19:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:19:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:19:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:19:53 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-11-29 23:20:02 [DEBUG   ] Got command BAM from MCS: ref #670801
2018-11-29 23:20:02 [INFO    ] Finished processing BAM request
2018-11-29 23:20:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670801   8 58451 84002033 A  ERROR'
2018-11-29 23:20:02 [DEBUG   ] Got command BAM from MCS: ref #670802
2018-11-29 23:20:02 [INFO    ] Finished processing BAM request
2018-11-29 23:20:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670802   8 58451 84002037 A  ERROR'
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:20:02 [DEBUG   ] spawn_process: at 2018-11-29 23:20:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:20:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 23:20:14 [DEBUG   ] Got command BAM from MCS: ref #670803
2018-11-29 23:20:14 [INFO    ] Finished processing BAM request
2018-11-29 23:20:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670803   8 58451 84014029 A  ERROR'
2018-11-29 23:20:14 [DEBUG   ] Got command BAM from MCS: ref #670804
2018-11-29 23:20:14 [INFO    ] Finished processing BAM request
2018-11-29 23:20:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670804   8 58451 84014033 A  ERROR'
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:20:14 [DEBUG   ] spawn_process: at 2018-11-29 23:20:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:20:26 [DEBUG   ] Got command BAM from MCS: ref #670810
2018-11-29 23:20:26 [INFO    ] Finished processing BAM request
2018-11-29 23:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670810   8 58451 84026033 A  ERROR'
2018-11-29 23:20:26 [DEBUG   ] Got command BAM from MCS: ref #670809
2018-11-29 23:20:26 [INFO    ] Finished processing BAM request
2018-11-29 23:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670809   8 58451 84026037 A  ERROR'
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:20:26 [DEBUG   ] spawn_process: at 2018-11-29 23:20:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:20:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 23:20:38 [DEBUG   ] Got command BAM from MCS: ref #670812
2018-11-29 23:20:38 [INFO    ] Finished processing BAM request
2018-11-29 23:20:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670812   8 58451 84038033 A  ERROR'
2018-11-29 23:20:38 [DEBUG   ] Got command BAM from MCS: ref #670811
2018-11-29 23:20:38 [INFO    ] Finished processing BAM request
2018-11-29 23:20:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670811   8 58451 84038037 A  ERROR'
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:20:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:20:38 [DEBUG   ] spawn_process: at 2018-11-29 23:20:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:20:49 [DEBUG   ] Got command RPT from MCS: ref #670815
2018-11-29 23:20:49 [DEBUG   ] summary = ERROR
2018-11-29 23:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670815  13 58451 84049825 A  ERRORERROR'
2018-11-29 23:20:49 [DEBUG   ] Got command RPT from MCS: ref #670816
2018-11-29 23:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670816  77 58451 84049826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:20:50 [DEBUG   ] Got command BAM from MCS: ref #670814
2018-11-29 23:20:50 [INFO    ] Finished processing BAM request
2018-11-29 23:20:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670814   8 58451 84050033 A  ERROR'
2018-11-29 23:20:50 [DEBUG   ] Got command BAM from MCS: ref #670813
2018-11-29 23:20:50 [INFO    ] Finished processing BAM request
2018-11-29 23:20:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670813   8 58451 84050037 A  ERROR'
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:20:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:20:50 [DEBUG   ] spawn_process: at 2018-11-29 23:20:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:20:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 23:20:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 23:20:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:20:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:20:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:20:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:20:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:20:53 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-29 23:21:02 [DEBUG   ] Got command BAM from MCS: ref #670833
2018-11-29 23:21:02 [INFO    ] Finished processing BAM request
2018-11-29 23:21:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670833   8 58451 84062029 A  ERROR'
2018-11-29 23:21:02 [DEBUG   ] Got command BAM from MCS: ref #670832
2018-11-29 23:21:02 [INFO    ] Finished processing BAM request
2018-11-29 23:21:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670832   8 58451 84062033 A  ERROR'
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:21:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:21:02 [DEBUG   ] spawn_process: at 2018-11-29 23:21:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:21:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 23:21:14 [DEBUG   ] Got command BAM from MCS: ref #670834
2018-11-29 23:21:14 [INFO    ] Finished processing BAM request
2018-11-29 23:21:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670834   8 58451 84074033 A  ERROR'
2018-11-29 23:21:14 [DEBUG   ] Got command BAM from MCS: ref #670835
2018-11-29 23:21:14 [INFO    ] Finished processing BAM request
2018-11-29 23:21:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670835   8 58451 84074037 A  ERROR'
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:21:14 [DEBUG   ] spawn_process: at 2018-11-29 23:21:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:21:25 [DEBUG   ] Got command BAM from MCS: ref #670836
2018-11-29 23:21:25 [INFO    ] Finished processing BAM request
2018-11-29 23:21:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670836   8 58451 84085025 A  ERROR'
2018-11-29 23:21:25 [DEBUG   ] Got command BAM from MCS: ref #670837
2018-11-29 23:21:25 [INFO    ] Finished processing BAM request
2018-11-29 23:21:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670837   8 58451 84085029 A  ERROR'
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:21:25 [DEBUG   ] spawn_process: at 2018-11-29 23:21:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:21:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:21:36 [DEBUG   ] Got command BAM from MCS: ref #670839
2018-11-29 23:21:36 [INFO    ] Finished processing BAM request
2018-11-29 23:21:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670839   8 58451 84096029 A  ERROR'
2018-11-29 23:21:36 [DEBUG   ] Got command BAM from MCS: ref #670838
2018-11-29 23:21:36 [INFO    ] Finished processing BAM request
2018-11-29 23:21:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670838   8 58451 84096033 A  ERROR'
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:21:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:21:36 [DEBUG   ] spawn_process: at 2018-11-29 23:21:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:21:47 [DEBUG   ] Got command BAM from MCS: ref #670840
2018-11-29 23:21:47 [INFO    ] Finished processing BAM request
2018-11-29 23:21:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670840   8 58451 84107029 A  ERROR'
2018-11-29 23:21:47 [DEBUG   ] Got command BAM from MCS: ref #670841
2018-11-29 23:21:47 [INFO    ] Finished processing BAM request
2018-11-29 23:21:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670841   8 58451 84107033 A  ERROR'
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:21:47 [DEBUG   ] spawn_process: at 2018-11-29 23:21:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:21:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:21:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-29 23:21:53 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 23:21:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:21:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:21:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:21:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:21:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:21:53 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-29 23:21:58 [DEBUG   ] Got command BAM from MCS: ref #670843
2018-11-29 23:21:58 [INFO    ] Finished processing BAM request
2018-11-29 23:21:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670843   8 58451 84118033 A  ERROR'
2018-11-29 23:21:58 [DEBUG   ] Got command BAM from MCS: ref #670842
2018-11-29 23:21:58 [INFO    ] Finished processing BAM request
2018-11-29 23:21:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670842   8 58451 84118037 A  ERROR'
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:21:58 [DEBUG   ] spawn_process: at 2018-11-29 23:21:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:22:09 [DEBUG   ] Got command BAM from MCS: ref #670844
2018-11-29 23:22:09 [INFO    ] Finished processing BAM request
2018-11-29 23:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670844   8 58451 84129033 A  ERROR'
2018-11-29 23:22:09 [DEBUG   ] Got command BAM from MCS: ref #670845
2018-11-29 23:22:09 [INFO    ] Finished processing BAM request
2018-11-29 23:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670845   8 58451 84129037 A  ERROR'
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:22:09 [DEBUG   ] spawn_process: at 2018-11-29 23:22:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:22:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:22:20 [DEBUG   ] Got command BAM from MCS: ref #670847
2018-11-29 23:22:20 [INFO    ] Finished processing BAM request
2018-11-29 23:22:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670847   8 58451 84140033 A  ERROR'
2018-11-29 23:22:20 [DEBUG   ] Got command BAM from MCS: ref #670846
2018-11-29 23:22:20 [INFO    ] Finished processing BAM request
2018-11-29 23:22:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670846   8 58451 84140037 A  ERROR'
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:22:20 [DEBUG   ] spawn_process: at 2018-11-29 23:22:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:22:31 [DEBUG   ] Got command BAM from MCS: ref #670849
2018-11-29 23:22:31 [INFO    ] Finished processing BAM request
2018-11-29 23:22:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670849   8 58451 84151033 A  ERROR'
2018-11-29 23:22:31 [DEBUG   ] Got command BAM from MCS: ref #670848
2018-11-29 23:22:31 [INFO    ] Finished processing BAM request
2018-11-29 23:22:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670848   8 58451 84151037 A  ERROR'
2018-11-29 23:22:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:22:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:22:31 [DEBUG   ] spawn_process: at 2018-11-29 23:22:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:22:42 [DEBUG   ] Got command BAM from MCS: ref #670850
2018-11-29 23:22:42 [INFO    ] Finished processing BAM request
2018-11-29 23:22:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670850   8 58451 84162033 A  ERROR'
2018-11-29 23:22:42 [DEBUG   ] Got command BAM from MCS: ref #670851
2018-11-29 23:22:42 [INFO    ] Finished processing BAM request
2018-11-29 23:22:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670851   8 58451 84162037 A  ERROR'
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:22:42 [DEBUG   ] spawn_process: at 2018-11-29 23:22:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:22:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:22:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 23:22:53 [DEBUG   ] Got command BAM from MCS: ref #670852
2018-11-29 23:22:53 [INFO    ] Finished processing BAM request
2018-11-29 23:22:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670852   8 58451 84173037 A  ERROR'
2018-11-29 23:22:53 [DEBUG   ] Got command BAM from MCS: ref #670853
2018-11-29 23:22:53 [INFO    ] Finished processing BAM request
2018-11-29 23:22:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:22:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670853   8 58451 84173041 A  ERROR'
2018-11-29 23:22:53 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:22:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:22:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:22:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:22:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:22:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:22:53 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:22:53 [DEBUG   ] spawn_process: at 2018-11-29 23:22:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:23:04 [DEBUG   ] Got command BAM from MCS: ref #670855
2018-11-29 23:23:04 [INFO    ] Finished processing BAM request
2018-11-29 23:23:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670855   8 58451 84184025 A  ERROR'
2018-11-29 23:23:04 [DEBUG   ] Got command BAM from MCS: ref #670854
2018-11-29 23:23:04 [INFO    ] Finished processing BAM request
2018-11-29 23:23:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670854   8 58451 84184029 A  ERROR'
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:23:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:23:04 [DEBUG   ] spawn_process: at 2018-11-29 23:23:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:23:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:23:15 [DEBUG   ] Got command BAM from MCS: ref #670857
2018-11-29 23:23:15 [INFO    ] Finished processing BAM request
2018-11-29 23:23:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670857   8 58451 84195029 A  ERROR'
2018-11-29 23:23:15 [DEBUG   ] Got command BAM from MCS: ref #670856
2018-11-29 23:23:15 [INFO    ] Finished processing BAM request
2018-11-29 23:23:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670856   8 58451 84195033 A  ERROR'
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:23:15 [DEBUG   ] spawn_process: at 2018-11-29 23:23:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:23:26 [DEBUG   ] Got command BAM from MCS: ref #670862
2018-11-29 23:23:26 [INFO    ] Finished processing BAM request
2018-11-29 23:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670862   8 58451 84206037 A  ERROR'
2018-11-29 23:23:26 [DEBUG   ] Got command BAM from MCS: ref #670863
2018-11-29 23:23:26 [INFO    ] Finished processing BAM request
2018-11-29 23:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670863   8 58451 84206045 A  ERROR'
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:23:26 [DEBUG   ] spawn_process: at 2018-11-29 23:23:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:23:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:23:37 [DEBUG   ] Got command BAM from MCS: ref #670864
2018-11-29 23:23:37 [INFO    ] Finished processing BAM request
2018-11-29 23:23:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670864   8 58451 84217025 A  ERROR'
2018-11-29 23:23:37 [DEBUG   ] Got command BAM from MCS: ref #670865
2018-11-29 23:23:37 [INFO    ] Finished processing BAM request
2018-11-29 23:23:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670865   8 58451 84217029 A  ERROR'
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:23:37 [DEBUG   ] spawn_process: at 2018-11-29 23:23:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:23:48 [DEBUG   ] Got command BAM from MCS: ref #670869
2018-11-29 23:23:48 [INFO    ] Finished processing BAM request
2018-11-29 23:23:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670869   8 58451 84228025 A  ERROR'
2018-11-29 23:23:48 [DEBUG   ] Got command BAM from MCS: ref #670868
2018-11-29 23:23:48 [INFO    ] Finished processing BAM request
2018-11-29 23:23:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670868   8 58451 84228029 A  ERROR'
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:23:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:23:48 [DEBUG   ] spawn_process: at 2018-11-29 23:23:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:23:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:23:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 23:23:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:23:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:23:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:23:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:23:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:23:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:23:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:23:53 [DEBUG   ] Finished updating board flags in 1.278 seconds
2018-11-29 23:23:59 [DEBUG   ] Got command BAM from MCS: ref #670870
2018-11-29 23:23:59 [INFO    ] Finished processing BAM request
2018-11-29 23:23:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670870   8 58451 84239033 A  ERROR'
2018-11-29 23:23:59 [DEBUG   ] Got command BAM from MCS: ref #670871
2018-11-29 23:23:59 [INFO    ] Finished processing BAM request
2018-11-29 23:23:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670871   8 58451 84239037 A  ERROR'
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:23:59 [DEBUG   ] spawn_process: at 2018-11-29 23:23:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:24:04 [DEBUG   ] Got command RPT from MCS: ref #670872
2018-11-29 23:24:04 [DEBUG   ] summary = ERROR
2018-11-29 23:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670872  13 58451 84244261 A  ERRORERROR'
2018-11-29 23:24:04 [DEBUG   ] Got command RPT from MCS: ref #670873
2018-11-29 23:24:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670873  77 58451 84244465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:24:04 [DEBUG   ] Got command RPT from MCS: ref #670874
2018-11-29 23:24:04 [DEBUG   ] summary = ERROR
2018-11-29 23:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670874  13 58451 84244669 A  ERRORERROR'
2018-11-29 23:24:04 [DEBUG   ] Got command RPT from MCS: ref #670876
2018-11-29 23:24:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670876  77 58451 84244861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:24:05 [DEBUG   ] Got command RPT from MCS: ref #670878
2018-11-29 23:24:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670878  12 58451 84245065 A  ERRORB¢ff'
2018-11-29 23:24:09 [DEBUG   ] Got command BAM from MCS: ref #670883
2018-11-29 23:24:09 [INFO    ] Finished processing BAM request
2018-11-29 23:24:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670883   8 58451 84249033 A  ERROR'
2018-11-29 23:24:09 [DEBUG   ] Got command BAM from MCS: ref #670882
2018-11-29 23:24:09 [INFO    ] Finished processing BAM request
2018-11-29 23:24:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670882   8 58451 84249037 A  ERROR'
2018-11-29 23:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:24:09 [DEBUG   ] spawn_process: at 2018-11-29 23:24:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:24:10 [DEBUG   ] spawn_process: at 2018-11-29 23:24:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:24:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:24:19 [DEBUG   ] Got command BAM from MCS: ref #670884
2018-11-29 23:24:19 [INFO    ] Finished processing BAM request
2018-11-29 23:24:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670884   8 58451 84259029 A  ERROR'
2018-11-29 23:24:19 [DEBUG   ] Got command BAM from MCS: ref #670885
2018-11-29 23:24:19 [INFO    ] Finished processing BAM request
2018-11-29 23:24:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670885   8 58451 84259033 A  ERROR'
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:24:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:24:19 [DEBUG   ] spawn_process: at 2018-11-29 23:24:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:24:29 [DEBUG   ] Got command BAM from MCS: ref #670887
2018-11-29 23:24:29 [INFO    ] Finished processing BAM request
2018-11-29 23:24:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670887   8 58451 84269025 A  ERROR'
2018-11-29 23:24:29 [DEBUG   ] Got command BAM from MCS: ref #670886
2018-11-29 23:24:29 [INFO    ] Finished processing BAM request
2018-11-29 23:24:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670886   8 58451 84269029 A  ERROR'
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:24:29 [DEBUG   ] spawn_process: at 2018-11-29 23:24:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:24:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:24:39 [DEBUG   ] Got command BAM from MCS: ref #670888
2018-11-29 23:24:39 [INFO    ] Finished processing BAM request
2018-11-29 23:24:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670888   8 58451 84279033 A  ERROR'
2018-11-29 23:24:39 [DEBUG   ] Got command BAM from MCS: ref #670889
2018-11-29 23:24:39 [INFO    ] Finished processing BAM request
2018-11-29 23:24:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670889   8 58451 84279037 A  ERROR'
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:24:39 [DEBUG   ] spawn_process: at 2018-11-29 23:24:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:24:49 [DEBUG   ] Got command BAM from MCS: ref #670890
2018-11-29 23:24:49 [INFO    ] Finished processing BAM request
2018-11-29 23:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670890   8 58451 84289025 A  ERROR'
2018-11-29 23:24:49 [DEBUG   ] Got command BAM from MCS: ref #670891
2018-11-29 23:24:49 [INFO    ] Finished processing BAM request
2018-11-29 23:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670891   8 58451 84289029 A  ERROR'
2018-11-29 23:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:24:49 [DEBUG   ] spawn_process: at 2018-11-29 23:24:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:24:50 [DEBUG   ] spawn_process: at 2018-11-29 23:24:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:24:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 23:24:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:24:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:24:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:24:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:24:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:24:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:24:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:24:53 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-29 23:24:59 [DEBUG   ] Got command BAM from MCS: ref #670892
2018-11-29 23:24:59 [INFO    ] Finished processing BAM request
2018-11-29 23:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670892   8 58451 84299025 A  ERROR'
2018-11-29 23:24:59 [DEBUG   ] Got command BAM from MCS: ref #670893
2018-11-29 23:24:59 [INFO    ] Finished processing BAM request
2018-11-29 23:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670893   8 58451 84299029 A  ERROR'
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:24:59 [DEBUG   ] spawn_process: at 2018-11-29 23:24:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:25:09 [DEBUG   ] Got command BAM from MCS: ref #670894
2018-11-29 23:25:09 [INFO    ] Finished processing BAM request
2018-11-29 23:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670894   8 58451 84309033 A  ERROR'
2018-11-29 23:25:09 [DEBUG   ] Got command BAM from MCS: ref #670895
2018-11-29 23:25:09 [INFO    ] Finished processing BAM request
2018-11-29 23:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670895   8 58451 84309037 A  ERROR'
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:25:09 [DEBUG   ] spawn_process: at 2018-11-29 23:25:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:25:11 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2018-11-29 23:25:19 [DEBUG   ] Got command BAM from MCS: ref #670896
2018-11-29 23:25:19 [INFO    ] Finished processing BAM request
2018-11-29 23:25:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670896   8 58451 84319033 A  ERROR'
2018-11-29 23:25:19 [DEBUG   ] Got command BAM from MCS: ref #670897
2018-11-29 23:25:19 [INFO    ] Finished processing BAM request
2018-11-29 23:25:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670897   8 58451 84319037 A  ERROR'
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:25:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:25:19 [DEBUG   ] spawn_process: at 2018-11-29 23:25:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:25:29 [DEBUG   ] Got command BAM from MCS: ref #670899
2018-11-29 23:25:29 [INFO    ] Finished processing BAM request
2018-11-29 23:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670899   8 58451 84329029 A  ERROR'
2018-11-29 23:25:29 [DEBUG   ] Got command BAM from MCS: ref #670898
2018-11-29 23:25:29 [INFO    ] Finished processing BAM request
2018-11-29 23:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670898   8 58451 84329033 A  ERROR'
2018-11-29 23:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:25:29 [DEBUG   ] spawn_process: at 2018-11-29 23:25:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:25:30 [DEBUG   ] spawn_process: at 2018-11-29 23:25:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:25:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:25:39 [DEBUG   ] Got command BAM from MCS: ref #670901
2018-11-29 23:25:39 [INFO    ] Finished processing BAM request
2018-11-29 23:25:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670901   8 58451 84339025 A  ERROR'
2018-11-29 23:25:39 [DEBUG   ] Got command BAM from MCS: ref #670900
2018-11-29 23:25:39 [INFO    ] Finished processing BAM request
2018-11-29 23:25:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670900   8 58451 84339029 A  ERROR'
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:25:39 [DEBUG   ] spawn_process: at 2018-11-29 23:25:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:25:49 [DEBUG   ] Got command BAM from MCS: ref #670903
2018-11-29 23:25:49 [INFO    ] Finished processing BAM request
2018-11-29 23:25:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670903   8 58451 84349029 A  ERROR'
2018-11-29 23:25:49 [DEBUG   ] Got command BAM from MCS: ref #670902
2018-11-29 23:25:49 [INFO    ] Finished processing BAM request
2018-11-29 23:25:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670902   8 58451 84349033 A  ERROR'
2018-11-29 23:25:49 [DEBUG   ] Got command RPT from MCS: ref #670904
2018-11-29 23:25:49 [DEBUG   ] summary = ERROR
2018-11-29 23:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670904  13 58451 84349825 A  ERRORERROR'
2018-11-29 23:25:49 [DEBUG   ] Got command RPT from MCS: ref #670905
2018-11-29 23:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670905  77 58451 84349826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:25:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:25:49 [DEBUG   ] spawn_process: at 2018-11-29 23:25:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:25:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:25:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-29 23:25:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:25:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:25:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:25:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:25:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:25:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:25:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:25:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:25:53 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-29 23:25:59 [DEBUG   ] Got command BAM from MCS: ref #670921
2018-11-29 23:25:59 [INFO    ] Finished processing BAM request
2018-11-29 23:25:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670921   8 58451 84359033 A  ERROR'
2018-11-29 23:25:59 [DEBUG   ] Got command BAM from MCS: ref #670922
2018-11-29 23:25:59 [INFO    ] Finished processing BAM request
2018-11-29 23:25:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670922   8 58451 84359037 A  ERROR'
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:25:59 [DEBUG   ] spawn_process: at 2018-11-29 23:25:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:26:09 [DEBUG   ] Got command BAM from MCS: ref #670923
2018-11-29 23:26:09 [INFO    ] Finished processing BAM request
2018-11-29 23:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670923   8 58451 84369025 A  ERROR'
2018-11-29 23:26:09 [DEBUG   ] Got command BAM from MCS: ref #670924
2018-11-29 23:26:09 [INFO    ] Finished processing BAM request
2018-11-29 23:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670924   8 58451 84369029 A  ERROR'
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:26:09 [DEBUG   ] spawn_process: at 2018-11-29 23:26:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:26:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:26:19 [DEBUG   ] Got command BAM from MCS: ref #670930
2018-11-29 23:26:19 [INFO    ] Finished processing BAM request
2018-11-29 23:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670930   8 58451 84379033 A  ERROR'
2018-11-29 23:26:19 [DEBUG   ] Got command BAM from MCS: ref #670929
2018-11-29 23:26:19 [INFO    ] Finished processing BAM request
2018-11-29 23:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670929   8 58451 84379037 A  ERROR'
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:26:19 [DEBUG   ] spawn_process: at 2018-11-29 23:26:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:26:29 [DEBUG   ] Got command BAM from MCS: ref #670931
2018-11-29 23:26:29 [INFO    ] Finished processing BAM request
2018-11-29 23:26:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670931   8 58451 84389033 A  ERROR'
2018-11-29 23:26:29 [DEBUG   ] Got command BAM from MCS: ref #670932
2018-11-29 23:26:29 [INFO    ] Finished processing BAM request
2018-11-29 23:26:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670932   8 58451 84389037 A  ERROR'
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:26:29 [DEBUG   ] spawn_process: at 2018-11-29 23:26:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:26:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:26:39 [DEBUG   ] Got command BAM from MCS: ref #670933
2018-11-29 23:26:39 [INFO    ] Finished processing BAM request
2018-11-29 23:26:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670933   8 58451 84399029 A  ERROR'
2018-11-29 23:26:39 [DEBUG   ] Got command BAM from MCS: ref #670934
2018-11-29 23:26:39 [INFO    ] Finished processing BAM request
2018-11-29 23:26:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670934   8 58451 84399033 A  ERROR'
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:26:39 [DEBUG   ] spawn_process: at 2018-11-29 23:26:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:26:49 [DEBUG   ] Got command BAM from MCS: ref #670935
2018-11-29 23:26:49 [INFO    ] Finished processing BAM request
2018-11-29 23:26:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670935   8 58451 84409025 A  ERROR'
2018-11-29 23:26:49 [DEBUG   ] Got command BAM from MCS: ref #670936
2018-11-29 23:26:49 [INFO    ] Finished processing BAM request
2018-11-29 23:26:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670936   8 58451 84409029 A  ERROR'
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:26:49 [DEBUG   ] spawn_process: at 2018-11-29 23:26:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:26:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 23:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:26:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:26:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:26:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 23:26:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:26:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:26:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:26:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:26:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:26:54 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-11-29 23:26:59 [DEBUG   ] Got command BAM from MCS: ref #670937
2018-11-29 23:26:59 [INFO    ] Finished processing BAM request
2018-11-29 23:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670937   8 58451 84419029 A  ERROR'
2018-11-29 23:26:59 [DEBUG   ] Got command BAM from MCS: ref #670938
2018-11-29 23:26:59 [INFO    ] Finished processing BAM request
2018-11-29 23:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670938   8 58451 84419033 A  ERROR'
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:26:59 [DEBUG   ] spawn_process: at 2018-11-29 23:26:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:27:09 [DEBUG   ] Got command BAM from MCS: ref #670940
2018-11-29 23:27:09 [INFO    ] Finished processing BAM request
2018-11-29 23:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670940   8 58451 84429033 A  ERROR'
2018-11-29 23:27:09 [DEBUG   ] Got command BAM from MCS: ref #670939
2018-11-29 23:27:09 [INFO    ] Finished processing BAM request
2018-11-29 23:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670939   8 58451 84429037 A  ERROR'
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:27:09 [DEBUG   ] spawn_process: at 2018-11-29 23:27:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:27:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:27:18 [DEBUG   ] Got command BAM from MCS: ref #670941
2018-11-29 23:27:18 [INFO    ] Finished processing BAM request
2018-11-29 23:27:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670941   8 58451 84438033 A  ERROR'
2018-11-29 23:27:18 [DEBUG   ] Got command BAM from MCS: ref #670942
2018-11-29 23:27:18 [INFO    ] Finished processing BAM request
2018-11-29 23:27:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670942   8 58451 84438037 A  ERROR'
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:27:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:27:18 [DEBUG   ] spawn_process: at 2018-11-29 23:27:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:27:27 [DEBUG   ] Got command BAM from MCS: ref #670943
2018-11-29 23:27:27 [INFO    ] Finished processing BAM request
2018-11-29 23:27:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670943   8 58451 84447029 A  ERROR'
2018-11-29 23:27:27 [DEBUG   ] Got command BAM from MCS: ref #670944
2018-11-29 23:27:27 [INFO    ] Finished processing BAM request
2018-11-29 23:27:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670944   8 58451 84447033 A  ERROR'
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:27:27 [DEBUG   ] spawn_process: at 2018-11-29 23:27:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:27:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:27:36 [DEBUG   ] Got command BAM from MCS: ref #670945
2018-11-29 23:27:36 [INFO    ] Finished processing BAM request
2018-11-29 23:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670945   8 58451 84456029 A  ERROR'
2018-11-29 23:27:36 [DEBUG   ] Got command BAM from MCS: ref #670946
2018-11-29 23:27:36 [INFO    ] Finished processing BAM request
2018-11-29 23:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670946   8 58451 84456033 A  ERROR'
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:27:36 [DEBUG   ] spawn_process: at 2018-11-29 23:27:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:27:45 [DEBUG   ] Got command BAM from MCS: ref #670947
2018-11-29 23:27:45 [INFO    ] Finished processing BAM request
2018-11-29 23:27:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670947   8 58451 84465029 A  ERROR'
2018-11-29 23:27:45 [DEBUG   ] Got command BAM from MCS: ref #670948
2018-11-29 23:27:45 [INFO    ] Finished processing BAM request
2018-11-29 23:27:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670948   8 58451 84465033 A  ERROR'
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:27:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:27:45 [DEBUG   ] spawn_process: at 2018-11-29 23:27:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:27:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-29 23:27:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 23:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:27:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:27:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:27:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:27:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:27:53 [WARNING ] (13, 1, 'bot')
2018-11-29 23:27:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:27:53 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-29 23:27:54 [DEBUG   ] Got command BAM from MCS: ref #670950
2018-11-29 23:27:54 [INFO    ] Finished processing BAM request
2018-11-29 23:27:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670950   8 58451 84474033 A  ERROR'
2018-11-29 23:27:54 [DEBUG   ] Got command BAM from MCS: ref #670949
2018-11-29 23:27:54 [INFO    ] Finished processing BAM request
2018-11-29 23:27:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:27:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670949   8 58451 84474037 A  ERROR'
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:27:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:27:54 [DEBUG   ] spawn_process: at 2018-11-29 23:27:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:28:03 [DEBUG   ] Got command BAM from MCS: ref #670952
2018-11-29 23:28:03 [INFO    ] Finished processing BAM request
2018-11-29 23:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670952   8 58451 84483033 A  ERROR'
2018-11-29 23:28:03 [DEBUG   ] Got command BAM from MCS: ref #670951
2018-11-29 23:28:03 [INFO    ] Finished processing BAM request
2018-11-29 23:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670951   8 58451 84483037 A  ERROR'
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:28:03 [DEBUG   ] spawn_process: at 2018-11-29 23:28:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:28:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:28:12 [DEBUG   ] Got command BAM from MCS: ref #670954
2018-11-29 23:28:12 [INFO    ] Finished processing BAM request
2018-11-29 23:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670954   8 58451 84492033 A  ERROR'
2018-11-29 23:28:12 [DEBUG   ] Got command BAM from MCS: ref #670953
2018-11-29 23:28:12 [INFO    ] Finished processing BAM request
2018-11-29 23:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670953   8 58451 84492037 A  ERROR'
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:28:12 [DEBUG   ] spawn_process: at 2018-11-29 23:28:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:28:21 [DEBUG   ] Got command BAM from MCS: ref #670956
2018-11-29 23:28:21 [INFO    ] Finished processing BAM request
2018-11-29 23:28:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670956   8 58451 84501033 A  ERROR'
2018-11-29 23:28:21 [DEBUG   ] Got command BAM from MCS: ref #670955
2018-11-29 23:28:21 [INFO    ] Finished processing BAM request
2018-11-29 23:28:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670955   8 58451 84501037 A  ERROR'
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:28:21 [DEBUG   ] spawn_process: at 2018-11-29 23:28:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:28:30 [DEBUG   ] Got command BAM from MCS: ref #670958
2018-11-29 23:28:30 [INFO    ] Finished processing BAM request
2018-11-29 23:28:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670958   8 58451 84510029 A  ERROR'
2018-11-29 23:28:30 [DEBUG   ] Got command BAM from MCS: ref #670957
2018-11-29 23:28:30 [INFO    ] Finished processing BAM request
2018-11-29 23:28:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670957   8 58451 84510033 A  ERROR'
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:28:30 [DEBUG   ] spawn_process: at 2018-11-29 23:28:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:28:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:28:39 [DEBUG   ] Got command BAM from MCS: ref #670960
2018-11-29 23:28:39 [INFO    ] Finished processing BAM request
2018-11-29 23:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670960   8 58451 84519025 A  ERROR'
2018-11-29 23:28:39 [DEBUG   ] Got command BAM from MCS: ref #670959
2018-11-29 23:28:39 [INFO    ] Finished processing BAM request
2018-11-29 23:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670959   8 58451 84519029 A  ERROR'
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:28:39 [DEBUG   ] spawn_process: at 2018-11-29 23:28:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:28:48 [DEBUG   ] Got command BAM from MCS: ref #670962
2018-11-29 23:28:48 [INFO    ] Finished processing BAM request
2018-11-29 23:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670962   8 58451 84528033 A  ERROR'
2018-11-29 23:28:48 [DEBUG   ] Got command BAM from MCS: ref #670961
2018-11-29 23:28:48 [INFO    ] Finished processing BAM request
2018-11-29 23:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670961   8 58451 84528037 A  ERROR'
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:28:48 [DEBUG   ] spawn_process: at 2018-11-29 23:28:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:28:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 23:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:28:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 23:28:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:28:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:28:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:28:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:28:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:28:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:28:54 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-11-29 23:28:57 [DEBUG   ] Got command BAM from MCS: ref #670963
2018-11-29 23:28:57 [INFO    ] Finished processing BAM request
2018-11-29 23:28:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670963   8 58451 84537029 A  ERROR'
2018-11-29 23:28:57 [DEBUG   ] Got command BAM from MCS: ref #670964
2018-11-29 23:28:57 [INFO    ] Finished processing BAM request
2018-11-29 23:28:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:28:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670964   8 58451 84537033 A  ERROR'
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:28:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:28:57 [DEBUG   ] spawn_process: at 2018-11-29 23:28:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:29:04 [DEBUG   ] Got command RPT from MCS: ref #670965
2018-11-29 23:29:04 [DEBUG   ] summary = ERROR
2018-11-29 23:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670965  13 58451 84544353 A  ERRORERROR'
2018-11-29 23:29:04 [DEBUG   ] Got command RPT from MCS: ref #670966
2018-11-29 23:29:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670966  77 58451 84544545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:29:04 [DEBUG   ] Got command RPT from MCS: ref #670967
2018-11-29 23:29:04 [DEBUG   ] summary = ERROR
2018-11-29 23:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670967  13 58451 84544749 A  ERRORERROR'
2018-11-29 23:29:04 [DEBUG   ] Got command RPT from MCS: ref #670968
2018-11-29 23:29:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670968  77 58451 84544953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:29:05 [DEBUG   ] Got command RPT from MCS: ref #670971
2018-11-29 23:29:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670971  12 58451 84545157 A  ERRORB£ff'
2018-11-29 23:29:06 [DEBUG   ] Got command BAM from MCS: ref #670969
2018-11-29 23:29:06 [INFO    ] Finished processing BAM request
2018-11-29 23:29:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670969   8 58451 84546025 A  ERROR'
2018-11-29 23:29:06 [DEBUG   ] Got command BAM from MCS: ref #670970
2018-11-29 23:29:06 [INFO    ] Finished processing BAM request
2018-11-29 23:29:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670970   8 58451 84546029 A  ERROR'
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:29:06 [DEBUG   ] spawn_process: at 2018-11-29 23:29:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:29:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:29:15 [DEBUG   ] Got command BAM from MCS: ref #670973
2018-11-29 23:29:15 [INFO    ] Finished processing BAM request
2018-11-29 23:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670973   8 58451 84555033 A  ERROR'
2018-11-29 23:29:15 [DEBUG   ] Got command BAM from MCS: ref #670972
2018-11-29 23:29:15 [INFO    ] Finished processing BAM request
2018-11-29 23:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670972   8 58451 84555037 A  ERROR'
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:29:15 [DEBUG   ] spawn_process: at 2018-11-29 23:29:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:29:24 [DEBUG   ] Got command BAM from MCS: ref #670978
2018-11-29 23:29:24 [INFO    ] Finished processing BAM request
2018-11-29 23:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670978   8 58451 84564029 A  ERROR'
2018-11-29 23:29:24 [DEBUG   ] Got command BAM from MCS: ref #670979
2018-11-29 23:29:24 [INFO    ] Finished processing BAM request
2018-11-29 23:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670979   8 58451 84564033 A  ERROR'
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:29:24 [DEBUG   ] spawn_process: at 2018-11-29 23:29:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:29:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:29:33 [DEBUG   ] Got command BAM from MCS: ref #670980
2018-11-29 23:29:33 [INFO    ] Finished processing BAM request
2018-11-29 23:29:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670980   8 58451 84573029 A  ERROR'
2018-11-29 23:29:33 [DEBUG   ] Got command BAM from MCS: ref #670981
2018-11-29 23:29:33 [INFO    ] Finished processing BAM request
2018-11-29 23:29:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670981   8 58451 84573033 A  ERROR'
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:29:33 [DEBUG   ] spawn_process: at 2018-11-29 23:29:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:29:42 [DEBUG   ] Got command BAM from MCS: ref #670982
2018-11-29 23:29:42 [INFO    ] Finished processing BAM request
2018-11-29 23:29:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670982   8 58451 84582025 A  ERROR'
2018-11-29 23:29:42 [DEBUG   ] Got command BAM from MCS: ref #670983
2018-11-29 23:29:42 [INFO    ] Finished processing BAM request
2018-11-29 23:29:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670983   8 58451 84582029 A  ERROR'
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:29:42 [DEBUG   ] spawn_process: at 2018-11-29 23:29:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:29:51 [DEBUG   ] Got command BAM from MCS: ref #670984
2018-11-29 23:29:51 [INFO    ] Finished processing BAM request
2018-11-29 23:29:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670984   8 58451 84591025 A  ERROR'
2018-11-29 23:29:51 [DEBUG   ] Got command BAM from MCS: ref #670985
2018-11-29 23:29:51 [INFO    ] Finished processing BAM request
2018-11-29 23:29:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670985   8 58451 84591029 A  ERROR'
2018-11-29 23:29:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:29:51 [DEBUG   ] spawn_process: at 2018-11-29 23:29:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 23:29:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:29:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:29:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:29:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:29:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:29:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:29:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:29:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:29:54 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-29 23:30:00 [DEBUG   ] Got command BAM from MCS: ref #670987
2018-11-29 23:30:00 [INFO    ] Finished processing BAM request
2018-11-29 23:30:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670987   8 58451 84600025 A  ERROR'
2018-11-29 23:30:00 [DEBUG   ] Got command BAM from MCS: ref #670986
2018-11-29 23:30:00 [INFO    ] Finished processing BAM request
2018-11-29 23:30:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670986   8 58451 84600029 A  ERROR'
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:30:00 [DEBUG   ] spawn_process: at 2018-11-29 23:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:30:09 [DEBUG   ] Got command BAM from MCS: ref #670989
2018-11-29 23:30:09 [INFO    ] Finished processing BAM request
2018-11-29 23:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670989   8 58451 84609029 A  ERROR'
2018-11-29 23:30:09 [DEBUG   ] Got command BAM from MCS: ref #670988
2018-11-29 23:30:09 [INFO    ] Finished processing BAM request
2018-11-29 23:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670988   8 58451 84609033 A  ERROR'
2018-11-29 23:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:30:09 [DEBUG   ] spawn_process: at 2018-11-29 23:30:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:30:10 [DEBUG   ] spawn_process: at 2018-11-29 23:30:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:30:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 23:30:18 [DEBUG   ] Got command BAM from MCS: ref #670991
2018-11-29 23:30:18 [INFO    ] Finished processing BAM request
2018-11-29 23:30:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670991   8 58451 84618029 A  ERROR'
2018-11-29 23:30:18 [DEBUG   ] Got command BAM from MCS: ref #670990
2018-11-29 23:30:18 [INFO    ] Finished processing BAM request
2018-11-29 23:30:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670990   8 58451 84618033 A  ERROR'
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:30:18 [DEBUG   ] spawn_process: at 2018-11-29 23:30:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:30:27 [DEBUG   ] Got command BAM from MCS: ref #670992
2018-11-29 23:30:27 [INFO    ] Finished processing BAM request
2018-11-29 23:30:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670992   8 58451 84627029 A  ERROR'
2018-11-29 23:30:27 [DEBUG   ] Got command BAM from MCS: ref #670993
2018-11-29 23:30:27 [INFO    ] Finished processing BAM request
2018-11-29 23:30:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670993   8 58451 84627033 A  ERROR'
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:30:27 [DEBUG   ] spawn_process: at 2018-11-29 23:30:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:30:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:30:36 [DEBUG   ] Got command BAM from MCS: ref #670994
2018-11-29 23:30:36 [INFO    ] Finished processing BAM request
2018-11-29 23:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670994   8 58451 84636025 A  ERROR'
2018-11-29 23:30:36 [DEBUG   ] Got command BAM from MCS: ref #670995
2018-11-29 23:30:36 [INFO    ] Finished processing BAM request
2018-11-29 23:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670995   8 58451 84636029 A  ERROR'
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:30:36 [DEBUG   ] spawn_process: at 2018-11-29 23:30:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:30:45 [DEBUG   ] Got command BAM from MCS: ref #670996
2018-11-29 23:30:45 [INFO    ] Finished processing BAM request
2018-11-29 23:30:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670996   8 58451 84645033 A  ERROR'
2018-11-29 23:30:45 [DEBUG   ] Got command BAM from MCS: ref #670997
2018-11-29 23:30:45 [INFO    ] Finished processing BAM request
2018-11-29 23:30:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   670997   8 58451 84645037 A  ERROR'
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:30:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:30:45 [DEBUG   ] spawn_process: at 2018-11-29 23:30:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:30:49 [DEBUG   ] Got command RPT from MCS: ref #670998
2018-11-29 23:30:49 [DEBUG   ] summary = ERROR
2018-11-29 23:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670998  13 58451 84649967 A  ERRORERROR'
2018-11-29 23:30:49 [DEBUG   ] Got command RPT from MCS: ref #670999
2018-11-29 23:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670999  77 58451 84649967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:30:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 23:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 23:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:30:54 [DEBUG   ] Got command BAM from MCS: ref #671016
2018-11-29 23:30:54 [INFO    ] Finished processing BAM request
2018-11-29 23:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671016   8 58451 84654026 A  ERROR'
2018-11-29 23:30:54 [DEBUG   ] Got command BAM from MCS: ref #671015
2018-11-29 23:30:54 [INFO    ] Finished processing BAM request
2018-11-29 23:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671015   8 58451 84654030 A  ERROR'
2018-11-29 23:30:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:30:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:30:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:30:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:30:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:30:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:30:54 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:30:54 [DEBUG   ] spawn_process: at 2018-11-29 23:30:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:31:02 [DEBUG   ] Got command BAM from MCS: ref #671018
2018-11-29 23:31:02 [INFO    ] Finished processing BAM request
2018-11-29 23:31:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671018   8 58451 84662026 A  ERROR'
2018-11-29 23:31:02 [DEBUG   ] Got command BAM from MCS: ref #671017
2018-11-29 23:31:02 [INFO    ] Finished processing BAM request
2018-11-29 23:31:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671017   8 58451 84662030 A  ERROR'
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:31:02 [DEBUG   ] spawn_process: at 2018-11-29 23:31:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:31:10 [DEBUG   ] Got command BAM from MCS: ref #671019
2018-11-29 23:31:10 [INFO    ] Finished processing BAM request
2018-11-29 23:31:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671019   8 58451 84670026 A  ERROR'
2018-11-29 23:31:10 [DEBUG   ] Got command BAM from MCS: ref #671020
2018-11-29 23:31:10 [INFO    ] Finished processing BAM request
2018-11-29 23:31:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671020   8 58451 84670030 A  ERROR'
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:31:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:31:10 [DEBUG   ] spawn_process: at 2018-11-29 23:31:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:31:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:31:18 [DEBUG   ] Got command BAM from MCS: ref #671022
2018-11-29 23:31:18 [INFO    ] Finished processing BAM request
2018-11-29 23:31:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671022   8 58451 84678026 A  ERROR'
2018-11-29 23:31:18 [DEBUG   ] Got command BAM from MCS: ref #671021
2018-11-29 23:31:18 [INFO    ] Finished processing BAM request
2018-11-29 23:31:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671021   8 58451 84678030 A  ERROR'
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:31:18 [DEBUG   ] spawn_process: at 2018-11-29 23:31:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:31:26 [DEBUG   ] Got command BAM from MCS: ref #671024
2018-11-29 23:31:26 [INFO    ] Finished processing BAM request
2018-11-29 23:31:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671024   8 58451 84686026 A  ERROR'
2018-11-29 23:31:26 [DEBUG   ] Got command BAM from MCS: ref #671023
2018-11-29 23:31:26 [INFO    ] Finished processing BAM request
2018-11-29 23:31:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671023   8 58451 84686030 A  ERROR'
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:31:26 [DEBUG   ] spawn_process: at 2018-11-29 23:31:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:31:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:31:34 [DEBUG   ] Got command BAM from MCS: ref #671026
2018-11-29 23:31:34 [INFO    ] Finished processing BAM request
2018-11-29 23:31:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671026   8 58451 84694026 A  ERROR'
2018-11-29 23:31:34 [DEBUG   ] Got command BAM from MCS: ref #671025
2018-11-29 23:31:34 [INFO    ] Finished processing BAM request
2018-11-29 23:31:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671025   8 58451 84694030 A  ERROR'
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:31:34 [DEBUG   ] spawn_process: at 2018-11-29 23:31:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:31:42 [DEBUG   ] Got command BAM from MCS: ref #671027
2018-11-29 23:31:42 [INFO    ] Finished processing BAM request
2018-11-29 23:31:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671027   8 58451 84702025 A  ERROR'
2018-11-29 23:31:42 [DEBUG   ] Got command BAM from MCS: ref #671028
2018-11-29 23:31:42 [INFO    ] Finished processing BAM request
2018-11-29 23:31:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671028   8 58451 84702029 A  ERROR'
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:31:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:31:42 [DEBUG   ] spawn_process: at 2018-11-29 23:31:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:31:50 [DEBUG   ] Got command BAM from MCS: ref #671029
2018-11-29 23:31:50 [INFO    ] Finished processing BAM request
2018-11-29 23:31:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671029   8 58451 84710025 A  ERROR'
2018-11-29 23:31:50 [DEBUG   ] Got command BAM from MCS: ref #671030
2018-11-29 23:31:50 [INFO    ] Finished processing BAM request
2018-11-29 23:31:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671030   8 58451 84710029 A  ERROR'
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:31:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:31:50 [DEBUG   ] spawn_process: at 2018-11-29 23:31:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:31:51 [DEBUG   ] Finished updating ant stats in 0.387 seconds
2018-11-29 23:31:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 23:31:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:31:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:31:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:31:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:31:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:31:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:31:54 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-29 23:31:58 [DEBUG   ] Got command BAM from MCS: ref #671031
2018-11-29 23:31:58 [INFO    ] Finished processing BAM request
2018-11-29 23:31:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671031   8 58451 84718033 A  ERROR'
2018-11-29 23:31:58 [DEBUG   ] Got command BAM from MCS: ref #671032
2018-11-29 23:31:58 [INFO    ] Finished processing BAM request
2018-11-29 23:31:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671032   8 58451 84718037 A  ERROR'
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:31:58 [DEBUG   ] spawn_process: at 2018-11-29 23:31:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:32:06 [DEBUG   ] Got command BAM from MCS: ref #671034
2018-11-29 23:32:06 [INFO    ] Finished processing BAM request
2018-11-29 23:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671034   8 58451 84726033 A  ERROR'
2018-11-29 23:32:06 [DEBUG   ] Got command BAM from MCS: ref #671033
2018-11-29 23:32:06 [INFO    ] Finished processing BAM request
2018-11-29 23:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671033   8 58451 84726037 A  ERROR'
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:32:06 [DEBUG   ] spawn_process: at 2018-11-29 23:32:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:32:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:32:14 [DEBUG   ] Got command BAM from MCS: ref #671035
2018-11-29 23:32:14 [INFO    ] Finished processing BAM request
2018-11-29 23:32:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671035   8 58451 84734033 A  ERROR'
2018-11-29 23:32:14 [DEBUG   ] Got command BAM from MCS: ref #671036
2018-11-29 23:32:14 [INFO    ] Finished processing BAM request
2018-11-29 23:32:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671036   8 58451 84734037 A  ERROR'
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:32:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:32:14 [DEBUG   ] spawn_process: at 2018-11-29 23:32:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:32:22 [DEBUG   ] Got command BAM from MCS: ref #671042
2018-11-29 23:32:22 [INFO    ] Finished processing BAM request
2018-11-29 23:32:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671042   8 58451 84742033 A  ERROR'
2018-11-29 23:32:22 [DEBUG   ] Got command BAM from MCS: ref #671041
2018-11-29 23:32:22 [INFO    ] Finished processing BAM request
2018-11-29 23:32:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671041   8 58451 84742037 A  ERROR'
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:32:22 [DEBUG   ] spawn_process: at 2018-11-29 23:32:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:32:30 [DEBUG   ] Got command BAM from MCS: ref #671043
2018-11-29 23:32:30 [INFO    ] Finished processing BAM request
2018-11-29 23:32:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671043   8 58451 84750033 A  ERROR'
2018-11-29 23:32:30 [DEBUG   ] Got command BAM from MCS: ref #671044
2018-11-29 23:32:30 [INFO    ] Finished processing BAM request
2018-11-29 23:32:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671044   8 58451 84750041 A  ERROR'
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:32:30 [DEBUG   ] spawn_process: at 2018-11-29 23:32:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:32:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 23:32:38 [DEBUG   ] Got command BAM from MCS: ref #671046
2018-11-29 23:32:38 [INFO    ] Finished processing BAM request
2018-11-29 23:32:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671046   8 58451 84758037 A  ERROR'
2018-11-29 23:32:38 [DEBUG   ] Got command BAM from MCS: ref #671045
2018-11-29 23:32:38 [INFO    ] Finished processing BAM request
2018-11-29 23:32:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671045   8 58451 84758041 A  ERROR'
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:32:38 [DEBUG   ] spawn_process: at 2018-11-29 23:32:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:32:46 [DEBUG   ] Got command BAM from MCS: ref #671048
2018-11-29 23:32:46 [INFO    ] Finished processing BAM request
2018-11-29 23:32:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671048   8 58451 84766025 A  ERROR'
2018-11-29 23:32:46 [DEBUG   ] Got command BAM from MCS: ref #671047
2018-11-29 23:32:46 [INFO    ] Finished processing BAM request
2018-11-29 23:32:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671047   8 58451 84766029 A  ERROR'
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:32:46 [DEBUG   ] spawn_process: at 2018-11-29 23:32:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:32:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:32:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:32:54 [DEBUG   ] Got command BAM from MCS: ref #671049
2018-11-29 23:32:54 [INFO    ] Finished processing BAM request
2018-11-29 23:32:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671049   8 58451 84774049 A  ERROR'
2018-11-29 23:32:54 [DEBUG   ] Got command BAM from MCS: ref #671050
2018-11-29 23:32:54 [INFO    ] Finished processing BAM request
2018-11-29 23:32:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:32:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671050   8 58451 84774053 A  ERROR'
2018-11-29 23:32:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 23:32:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:32:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:32:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:32:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:32:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:32:54 [DEBUG   ] Finished updating board flags in 1.265 seconds
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:32:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:32:54 [DEBUG   ] spawn_process: at 2018-11-29 23:32:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:33:02 [DEBUG   ] Got command BAM from MCS: ref #671052
2018-11-29 23:33:02 [INFO    ] Finished processing BAM request
2018-11-29 23:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671052   8 58451 84782025 A  ERROR'
2018-11-29 23:33:02 [DEBUG   ] Got command BAM from MCS: ref #671051
2018-11-29 23:33:02 [INFO    ] Finished processing BAM request
2018-11-29 23:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671051   8 58451 84782029 A  ERROR'
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:33:02 [DEBUG   ] spawn_process: at 2018-11-29 23:33:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:33:10 [DEBUG   ] Got command BAM from MCS: ref #671054
2018-11-29 23:33:10 [INFO    ] Finished processing BAM request
2018-11-29 23:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671054   8 58451 84790029 A  ERROR'
2018-11-29 23:33:10 [DEBUG   ] Got command BAM from MCS: ref #671053
2018-11-29 23:33:10 [INFO    ] Finished processing BAM request
2018-11-29 23:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671053   8 58451 84790033 A  ERROR'
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:33:10 [DEBUG   ] spawn_process: at 2018-11-29 23:33:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:33:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 23:33:18 [DEBUG   ] Got command BAM from MCS: ref #671055
2018-11-29 23:33:18 [INFO    ] Finished processing BAM request
2018-11-29 23:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671055   8 58451 84798045 A  ERROR'
2018-11-29 23:33:18 [DEBUG   ] Got command BAM from MCS: ref #671056
2018-11-29 23:33:18 [INFO    ] Finished processing BAM request
2018-11-29 23:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671056   8 58451 84798049 A  ERROR'
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:33:18 [DEBUG   ] spawn_process: at 2018-11-29 23:33:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:33:26 [DEBUG   ] Got command BAM from MCS: ref #671058
2018-11-29 23:33:26 [INFO    ] Finished processing BAM request
2018-11-29 23:33:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671058   8 58451 84806033 A  ERROR'
2018-11-29 23:33:26 [DEBUG   ] Got command BAM from MCS: ref #671057
2018-11-29 23:33:26 [INFO    ] Finished processing BAM request
2018-11-29 23:33:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671057   8 58451 84806037 A  ERROR'
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:33:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:33:26 [DEBUG   ] spawn_process: at 2018-11-29 23:33:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:33:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:33:34 [DEBUG   ] Got command BAM from MCS: ref #671060
2018-11-29 23:33:34 [INFO    ] Finished processing BAM request
2018-11-29 23:33:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671060   8 58451 84814025 A  ERROR'
2018-11-29 23:33:34 [DEBUG   ] Got command BAM from MCS: ref #671059
2018-11-29 23:33:34 [INFO    ] Finished processing BAM request
2018-11-29 23:33:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671059   8 58451 84814029 A  ERROR'
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:33:34 [DEBUG   ] spawn_process: at 2018-11-29 23:33:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:33:42 [DEBUG   ] Got command BAM from MCS: ref #671062
2018-11-29 23:33:42 [INFO    ] Finished processing BAM request
2018-11-29 23:33:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671062   8 58451 84822025 A  ERROR'
2018-11-29 23:33:42 [DEBUG   ] Got command BAM from MCS: ref #671061
2018-11-29 23:33:42 [INFO    ] Finished processing BAM request
2018-11-29 23:33:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671061   8 58451 84822029 A  ERROR'
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:33:42 [DEBUG   ] spawn_process: at 2018-11-29 23:33:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:33:50 [DEBUG   ] Got command BAM from MCS: ref #671065
2018-11-29 23:33:50 [INFO    ] Finished processing BAM request
2018-11-29 23:33:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671065   8 58451 84830025 A  ERROR'
2018-11-29 23:33:50 [DEBUG   ] Got command BAM from MCS: ref #671066
2018-11-29 23:33:50 [INFO    ] Finished processing BAM request
2018-11-29 23:33:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671066   8 58451 84830029 A  ERROR'
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:33:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:33:50 [DEBUG   ] spawn_process: at 2018-11-29 23:33:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:33:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-29 23:33:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:33:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:33:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:33:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:33:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:33:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:33:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:33:54 [DEBUG   ] Finished updating board flags in 1.128 seconds
2018-11-29 23:33:58 [DEBUG   ] Got command BAM from MCS: ref #671067
2018-11-29 23:33:58 [INFO    ] Finished processing BAM request
2018-11-29 23:33:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671067   8 58451 84838029 A  ERROR'
2018-11-29 23:33:58 [DEBUG   ] Got command BAM from MCS: ref #671068
2018-11-29 23:33:58 [INFO    ] Finished processing BAM request
2018-11-29 23:33:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:33:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671068   8 58451 84838033 A  ERROR'
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:33:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:33:58 [DEBUG   ] spawn_process: at 2018-11-29 23:33:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:34:04 [DEBUG   ] Got command RPT from MCS: ref #671069
2018-11-29 23:34:04 [DEBUG   ] summary = ERROR
2018-11-29 23:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671069  13 58451 84844429 A  ERRORERROR'
2018-11-29 23:34:04 [DEBUG   ] Got command RPT from MCS: ref #671070
2018-11-29 23:34:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671070  77 58451 84844633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:34:04 [DEBUG   ] Got command RPT from MCS: ref #671071
2018-11-29 23:34:04 [DEBUG   ] summary = ERROR
2018-11-29 23:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671071  13 58451 84844837 A  ERRORERROR'
2018-11-29 23:34:05 [DEBUG   ] Got command RPT from MCS: ref #671075
2018-11-29 23:34:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671075  77 58451 84845041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:34:05 [DEBUG   ] Got command RPT from MCS: ref #671077
2018-11-29 23:34:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671077  12 58451 84845233 A  ERRORB¢ff'
2018-11-29 23:34:06 [DEBUG   ] Got command BAM from MCS: ref #671073
2018-11-29 23:34:06 [INFO    ] Finished processing BAM request
2018-11-29 23:34:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671073   8 58451 84846029 A  ERROR'
2018-11-29 23:34:06 [DEBUG   ] Got command BAM from MCS: ref #671072
2018-11-29 23:34:06 [INFO    ] Finished processing BAM request
2018-11-29 23:34:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671072   8 58451 84846033 A  ERROR'
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:34:06 [DEBUG   ] spawn_process: at 2018-11-29 23:34:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:34:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:34:14 [DEBUG   ] Got command BAM from MCS: ref #671082
2018-11-29 23:34:14 [INFO    ] Finished processing BAM request
2018-11-29 23:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671082   8 58451 84854025 A  ERROR'
2018-11-29 23:34:14 [DEBUG   ] Got command BAM from MCS: ref #671081
2018-11-29 23:34:14 [INFO    ] Finished processing BAM request
2018-11-29 23:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671081   8 58451 84854029 A  ERROR'
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:34:14 [DEBUG   ] spawn_process: at 2018-11-29 23:34:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:34:22 [DEBUG   ] Got command BAM from MCS: ref #671084
2018-11-29 23:34:22 [INFO    ] Finished processing BAM request
2018-11-29 23:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671084   8 58451 84862025 A  ERROR'
2018-11-29 23:34:22 [DEBUG   ] Got command BAM from MCS: ref #671083
2018-11-29 23:34:22 [INFO    ] Finished processing BAM request
2018-11-29 23:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671083   8 58451 84862029 A  ERROR'
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:34:22 [DEBUG   ] spawn_process: at 2018-11-29 23:34:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:34:30 [DEBUG   ] Got command BAM from MCS: ref #671086
2018-11-29 23:34:30 [INFO    ] Finished processing BAM request
2018-11-29 23:34:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671086   8 58451 84870025 A  ERROR'
2018-11-29 23:34:30 [DEBUG   ] Got command BAM from MCS: ref #671085
2018-11-29 23:34:30 [INFO    ] Finished processing BAM request
2018-11-29 23:34:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671085   8 58451 84870029 A  ERROR'
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:34:30 [DEBUG   ] spawn_process: at 2018-11-29 23:34:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:34:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:34:38 [DEBUG   ] Got command BAM from MCS: ref #671087
2018-11-29 23:34:38 [INFO    ] Finished processing BAM request
2018-11-29 23:34:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671087   8 58451 84878025 A  ERROR'
2018-11-29 23:34:38 [DEBUG   ] Got command BAM from MCS: ref #671088
2018-11-29 23:34:38 [INFO    ] Finished processing BAM request
2018-11-29 23:34:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671088   8 58451 84878029 A  ERROR'
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:34:38 [DEBUG   ] spawn_process: at 2018-11-29 23:34:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:34:46 [DEBUG   ] Got command BAM from MCS: ref #671090
2018-11-29 23:34:46 [INFO    ] Finished processing BAM request
2018-11-29 23:34:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671090   8 58451 84886025 A  ERROR'
2018-11-29 23:34:46 [DEBUG   ] Got command BAM from MCS: ref #671089
2018-11-29 23:34:46 [INFO    ] Finished processing BAM request
2018-11-29 23:34:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671089   8 58451 84886029 A  ERROR'
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:34:46 [DEBUG   ] spawn_process: at 2018-11-29 23:34:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:34:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:34:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 23:34:54 [DEBUG   ] Got command BAM from MCS: ref #671092
2018-11-29 23:34:54 [INFO    ] Finished processing BAM request
2018-11-29 23:34:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671092   8 58451 84894033 A  ERROR'
2018-11-29 23:34:54 [DEBUG   ] Got command BAM from MCS: ref #671091
2018-11-29 23:34:54 [INFO    ] Finished processing BAM request
2018-11-29 23:34:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671091   8 58451 84894037 A  ERROR'
2018-11-29 23:34:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:34:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:34:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:34:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:34:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:34:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:34:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:34:54 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:34:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:34:54 [DEBUG   ] spawn_process: at 2018-11-29 23:34:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:35:02 [DEBUG   ] Got command BAM from MCS: ref #671093
2018-11-29 23:35:02 [INFO    ] Finished processing BAM request
2018-11-29 23:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671093   8 58451 84902025 A  ERROR'
2018-11-29 23:35:02 [DEBUG   ] Got command BAM from MCS: ref #671094
2018-11-29 23:35:02 [INFO    ] Finished processing BAM request
2018-11-29 23:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671094   8 58451 84902029 A  ERROR'
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:35:02 [DEBUG   ] spawn_process: at 2018-11-29 23:35:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:35:10 [DEBUG   ] Got command BAM from MCS: ref #671095
2018-11-29 23:35:10 [INFO    ] Finished processing BAM request
2018-11-29 23:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671095   8 58451 84910037 A  ERROR'
2018-11-29 23:35:10 [DEBUG   ] Got command BAM from MCS: ref #671096
2018-11-29 23:35:10 [INFO    ] Finished processing BAM request
2018-11-29 23:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671096   8 58451 84910045 A  ERROR'
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:35:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:35:10 [DEBUG   ] spawn_process: at 2018-11-29 23:35:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:35:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:35:18 [DEBUG   ] Got command BAM from MCS: ref #671102
2018-11-29 23:35:18 [INFO    ] Finished processing BAM request
2018-11-29 23:35:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671102   8 58451 84918029 A  ERROR'
2018-11-29 23:35:18 [DEBUG   ] Got command BAM from MCS: ref #671101
2018-11-29 23:35:18 [INFO    ] Finished processing BAM request
2018-11-29 23:35:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671101   8 58451 84918033 A  ERROR'
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:35:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:35:18 [DEBUG   ] spawn_process: at 2018-11-29 23:35:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:35:26 [DEBUG   ] Got command BAM from MCS: ref #671103
2018-11-29 23:35:26 [INFO    ] Finished processing BAM request
2018-11-29 23:35:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671103   8 58451 84926029 A  ERROR'
2018-11-29 23:35:26 [DEBUG   ] Got command BAM from MCS: ref #671104
2018-11-29 23:35:26 [INFO    ] Finished processing BAM request
2018-11-29 23:35:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671104   8 58451 84926033 A  ERROR'
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:35:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:35:26 [DEBUG   ] spawn_process: at 2018-11-29 23:35:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:35:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:35:34 [DEBUG   ] Got command BAM from MCS: ref #671106
2018-11-29 23:35:34 [INFO    ] Finished processing BAM request
2018-11-29 23:35:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671106   8 58451 84934033 A  ERROR'
2018-11-29 23:35:34 [DEBUG   ] Got command BAM from MCS: ref #671105
2018-11-29 23:35:34 [INFO    ] Finished processing BAM request
2018-11-29 23:35:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671105   8 58451 84934037 A  ERROR'
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:35:34 [DEBUG   ] spawn_process: at 2018-11-29 23:35:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:35:41 [DEBUG   ] Got command BAM from MCS: ref #671108
2018-11-29 23:35:41 [INFO    ] Finished processing BAM request
2018-11-29 23:35:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671108   8 58451 84941025 A  ERROR'
2018-11-29 23:35:41 [DEBUG   ] Got command BAM from MCS: ref #671107
2018-11-29 23:35:41 [INFO    ] Finished processing BAM request
2018-11-29 23:35:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671107   8 58451 84941029 A  ERROR'
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:35:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:35:41 [DEBUG   ] spawn_process: at 2018-11-29 23:35:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:35:48 [DEBUG   ] Got command BAM from MCS: ref #671109
2018-11-29 23:35:48 [INFO    ] Finished processing BAM request
2018-11-29 23:35:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671109   8 58451 84948033 A  ERROR'
2018-11-29 23:35:48 [DEBUG   ] Got command BAM from MCS: ref #671110
2018-11-29 23:35:48 [INFO    ] Finished processing BAM request
2018-11-29 23:35:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671110   8 58451 84948041 A  ERROR'
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:35:48 [DEBUG   ] spawn_process: at 2018-11-29 23:35:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:35:49 [DEBUG   ] Got command RPT from MCS: ref #671111
2018-11-29 23:35:49 [DEBUG   ] summary = ERROR
2018-11-29 23:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671111  13 58451 84949829 A  ERRORERROR'
2018-11-29 23:35:49 [DEBUG   ] Got command RPT from MCS: ref #671112
2018-11-29 23:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671112  77 58451 84949830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:35:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 23:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:35:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:35:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:35:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:35:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:35:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:35:54 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-29 23:35:55 [DEBUG   ] Got command BAM from MCS: ref #671128
2018-11-29 23:35:55 [INFO    ] Finished processing BAM request
2018-11-29 23:35:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671128   8 58451 84955029 A  ERROR'
2018-11-29 23:35:55 [DEBUG   ] Got command BAM from MCS: ref #671129
2018-11-29 23:35:55 [INFO    ] Finished processing BAM request
2018-11-29 23:35:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671129   8 58451 84955033 A  ERROR'
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:35:55 [DEBUG   ] spawn_process: at 2018-11-29 23:35:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:36:02 [DEBUG   ] Got command BAM from MCS: ref #671130
2018-11-29 23:36:02 [INFO    ] Finished processing BAM request
2018-11-29 23:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671130   8 58451 84962025 A  ERROR'
2018-11-29 23:36:02 [DEBUG   ] Got command BAM from MCS: ref #671131
2018-11-29 23:36:02 [INFO    ] Finished processing BAM request
2018-11-29 23:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671131   8 58451 84962029 A  ERROR'
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:36:02 [DEBUG   ] spawn_process: at 2018-11-29 23:36:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:36:09 [DEBUG   ] Got command BAM from MCS: ref #671132
2018-11-29 23:36:09 [INFO    ] Finished processing BAM request
2018-11-29 23:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671132   8 58451 84969029 A  ERROR'
2018-11-29 23:36:09 [DEBUG   ] Got command BAM from MCS: ref #671133
2018-11-29 23:36:09 [INFO    ] Finished processing BAM request
2018-11-29 23:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671133   8 58451 84969033 A  ERROR'
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:36:09 [DEBUG   ] spawn_process: at 2018-11-29 23:36:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:36:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-29 23:36:16 [DEBUG   ] Got command BAM from MCS: ref #671135
2018-11-29 23:36:16 [INFO    ] Finished processing BAM request
2018-11-29 23:36:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671135   8 58451 84976033 A  ERROR'
2018-11-29 23:36:16 [DEBUG   ] Got command BAM from MCS: ref #671134
2018-11-29 23:36:16 [INFO    ] Finished processing BAM request
2018-11-29 23:36:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671134   8 58451 84976037 A  ERROR'
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:36:16 [DEBUG   ] spawn_process: at 2018-11-29 23:36:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:36:23 [DEBUG   ] Got command BAM from MCS: ref #671137
2018-11-29 23:36:23 [INFO    ] Finished processing BAM request
2018-11-29 23:36:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671137   8 58451 84983037 A  ERROR'
2018-11-29 23:36:23 [DEBUG   ] Got command BAM from MCS: ref #671136
2018-11-29 23:36:23 [INFO    ] Finished processing BAM request
2018-11-29 23:36:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671136   8 58451 84983041 A  ERROR'
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:36:23 [DEBUG   ] spawn_process: at 2018-11-29 23:36:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:36:30 [DEBUG   ] Got command BAM from MCS: ref #671139
2018-11-29 23:36:30 [INFO    ] Finished processing BAM request
2018-11-29 23:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671139   8 58451 84990029 A  ERROR'
2018-11-29 23:36:30 [DEBUG   ] Got command BAM from MCS: ref #671138
2018-11-29 23:36:30 [INFO    ] Finished processing BAM request
2018-11-29 23:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671138   8 58451 84990033 A  ERROR'
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:36:30 [DEBUG   ] spawn_process: at 2018-11-29 23:36:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:36:32 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-29 23:36:37 [DEBUG   ] Got command BAM from MCS: ref #671141
2018-11-29 23:36:37 [INFO    ] Finished processing BAM request
2018-11-29 23:36:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671141   8 58451 84997033 A  ERROR'
2018-11-29 23:36:37 [DEBUG   ] Got command BAM from MCS: ref #671140
2018-11-29 23:36:37 [INFO    ] Finished processing BAM request
2018-11-29 23:36:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671140   8 58451 84997037 A  ERROR'
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:36:37 [DEBUG   ] spawn_process: at 2018-11-29 23:36:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:36:44 [DEBUG   ] Got command BAM from MCS: ref #671143
2018-11-29 23:36:44 [INFO    ] Finished processing BAM request
2018-11-29 23:36:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671143   8 58451 85004037 A  ERROR'
2018-11-29 23:36:44 [DEBUG   ] Got command BAM from MCS: ref #671142
2018-11-29 23:36:44 [INFO    ] Finished processing BAM request
2018-11-29 23:36:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671142   8 58451 85004045 A  ERROR'
2018-11-29 23:36:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:36:44 [DEBUG   ] spawn_process: at 2018-11-29 23:36:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:36:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:36:45 [DEBUG   ] spawn_process: at 2018-11-29 23:36:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:36:51 [DEBUG   ] Got command BAM from MCS: ref #671145
2018-11-29 23:36:51 [INFO    ] Finished processing BAM request
2018-11-29 23:36:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671145   8 58451 85011037 A  ERROR'
2018-11-29 23:36:51 [DEBUG   ] Got command BAM from MCS: ref #671144
2018-11-29 23:36:51 [INFO    ] Finished processing BAM request
2018-11-29 23:36:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671144   8 58451 85011045 A  ERROR'
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:36:51 [DEBUG   ] spawn_process: at 2018-11-29 23:36:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:36:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:36:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:36:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:36:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:36:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:36:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:36:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:36:54 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-29 23:36:58 [DEBUG   ] Got command BAM from MCS: ref #671146
2018-11-29 23:36:58 [INFO    ] Finished processing BAM request
2018-11-29 23:36:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671146   8 58451 85018025 A  ERROR'
2018-11-29 23:36:58 [DEBUG   ] Got command BAM from MCS: ref #671147
2018-11-29 23:36:58 [INFO    ] Finished processing BAM request
2018-11-29 23:36:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671147   8 58451 85018029 A  ERROR'
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:36:58 [DEBUG   ] spawn_process: at 2018-11-29 23:36:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:37:05 [DEBUG   ] Got command BAM from MCS: ref #671148
2018-11-29 23:37:05 [INFO    ] Finished processing BAM request
2018-11-29 23:37:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671148   8 58451 85025029 A  ERROR'
2018-11-29 23:37:05 [DEBUG   ] Got command BAM from MCS: ref #671149
2018-11-29 23:37:05 [INFO    ] Finished processing BAM request
2018-11-29 23:37:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671149   8 58451 85025033 A  ERROR'
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:37:05 [DEBUG   ] spawn_process: at 2018-11-29 23:37:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:37:12 [DEBUG   ] Got command BAM from MCS: ref #671151
2018-11-29 23:37:12 [INFO    ] Finished processing BAM request
2018-11-29 23:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671151   8 58451 85032033 A  ERROR'
2018-11-29 23:37:12 [DEBUG   ] Got command BAM from MCS: ref #671150
2018-11-29 23:37:12 [INFO    ] Finished processing BAM request
2018-11-29 23:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671150   8 58451 85032037 A  ERROR'
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:37:12 [DEBUG   ] spawn_process: at 2018-11-29 23:37:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:37:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:37:19 [DEBUG   ] Got command BAM from MCS: ref #671153
2018-11-29 23:37:19 [INFO    ] Finished processing BAM request
2018-11-29 23:37:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671153   8 58451 85039029 A  ERROR'
2018-11-29 23:37:19 [DEBUG   ] Got command BAM from MCS: ref #671152
2018-11-29 23:37:19 [INFO    ] Finished processing BAM request
2018-11-29 23:37:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671152   8 58451 85039033 A  ERROR'
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:37:20 [DEBUG   ] spawn_process: at 2018-11-29 23:37:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:37:26 [DEBUG   ] Got command BAM from MCS: ref #671155
2018-11-29 23:37:26 [INFO    ] Finished processing BAM request
2018-11-29 23:37:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671155   8 58451 85046033 A  ERROR'
2018-11-29 23:37:26 [DEBUG   ] Got command BAM from MCS: ref #671154
2018-11-29 23:37:26 [INFO    ] Finished processing BAM request
2018-11-29 23:37:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671154   8 58451 85046037 A  ERROR'
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:37:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:37:26 [DEBUG   ] spawn_process: at 2018-11-29 23:37:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:37:33 [DEBUG   ] Got command BAM from MCS: ref #671156
2018-11-29 23:37:33 [INFO    ] Finished processing BAM request
2018-11-29 23:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671156   8 58451 85053029 A  ERROR'
2018-11-29 23:37:33 [DEBUG   ] Got command BAM from MCS: ref #671157
2018-11-29 23:37:33 [INFO    ] Finished processing BAM request
2018-11-29 23:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671157   8 58451 85053033 A  ERROR'
2018-11-29 23:37:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:37:33 [DEBUG   ] spawn_process: at 2018-11-29 23:37:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:37:40 [DEBUG   ] Got command BAM from MCS: ref #671158
2018-11-29 23:37:40 [INFO    ] Finished processing BAM request
2018-11-29 23:37:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671158   8 58451 85060037 A  ERROR'
2018-11-29 23:37:40 [DEBUG   ] Got command BAM from MCS: ref #671159
2018-11-29 23:37:40 [INFO    ] Finished processing BAM request
2018-11-29 23:37:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671159   8 58451 85060045 A  ERROR'
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:37:40 [DEBUG   ] spawn_process: at 2018-11-29 23:37:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:37:47 [DEBUG   ] Got command BAM from MCS: ref #671160
2018-11-29 23:37:47 [INFO    ] Finished processing BAM request
2018-11-29 23:37:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671160   8 58451 85067033 A  ERROR'
2018-11-29 23:37:47 [DEBUG   ] Got command BAM from MCS: ref #671161
2018-11-29 23:37:47 [INFO    ] Finished processing BAM request
2018-11-29 23:37:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671161   8 58451 85067037 A  ERROR'
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:37:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:37:47 [DEBUG   ] spawn_process: at 2018-11-29 23:37:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:37:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 23:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:37:54 [DEBUG   ] Got command BAM from MCS: ref #671162
2018-11-29 23:37:54 [INFO    ] Finished processing BAM request
2018-11-29 23:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671162   8 58451 85074037 A  ERROR'
2018-11-29 23:37:54 [DEBUG   ] Got command BAM from MCS: ref #671163
2018-11-29 23:37:54 [INFO    ] Finished processing BAM request
2018-11-29 23:37:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:37:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671163   8 58451 85074041 A  ERROR'
2018-11-29 23:37:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:37:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:37:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:37:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:37:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:37:54 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:37:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:37:55 [DEBUG   ] spawn_process: at 2018-11-29 23:37:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:38:01 [DEBUG   ] Got command BAM from MCS: ref #671164
2018-11-29 23:38:01 [INFO    ] Finished processing BAM request
2018-11-29 23:38:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671164   8 58451 85081029 A  ERROR'
2018-11-29 23:38:01 [DEBUG   ] Got command BAM from MCS: ref #671165
2018-11-29 23:38:01 [INFO    ] Finished processing BAM request
2018-11-29 23:38:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671165   8 58451 85081033 A  ERROR'
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:38:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:38:01 [DEBUG   ] spawn_process: at 2018-11-29 23:38:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:38:08 [DEBUG   ] Got command BAM from MCS: ref #671166
2018-11-29 23:38:08 [INFO    ] Finished processing BAM request
2018-11-29 23:38:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671166   8 58451 85088033 A  ERROR'
2018-11-29 23:38:08 [DEBUG   ] Got command BAM from MCS: ref #671167
2018-11-29 23:38:08 [INFO    ] Finished processing BAM request
2018-11-29 23:38:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671167   8 58451 85088037 A  ERROR'
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:38:08 [DEBUG   ] spawn_process: at 2018-11-29 23:38:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:38:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 23:38:15 [DEBUG   ] Got command BAM from MCS: ref #671168
2018-11-29 23:38:15 [INFO    ] Finished processing BAM request
2018-11-29 23:38:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671168   8 58451 85095025 A  ERROR'
2018-11-29 23:38:15 [DEBUG   ] Got command BAM from MCS: ref #671169
2018-11-29 23:38:15 [INFO    ] Finished processing BAM request
2018-11-29 23:38:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671169   8 58451 85095029 A  ERROR'
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:38:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:38:15 [DEBUG   ] spawn_process: at 2018-11-29 23:38:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:38:22 [DEBUG   ] Got command BAM from MCS: ref #671174
2018-11-29 23:38:22 [INFO    ] Finished processing BAM request
2018-11-29 23:38:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671174   8 58451 85102029 A  ERROR'
2018-11-29 23:38:22 [DEBUG   ] Got command BAM from MCS: ref #671175
2018-11-29 23:38:22 [INFO    ] Finished processing BAM request
2018-11-29 23:38:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671175   8 58451 85102033 A  ERROR'
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:38:22 [DEBUG   ] spawn_process: at 2018-11-29 23:38:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:38:29 [DEBUG   ] Got command BAM from MCS: ref #671177
2018-11-29 23:38:29 [INFO    ] Finished processing BAM request
2018-11-29 23:38:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671177   8 58451 85109033 A  ERROR'
2018-11-29 23:38:29 [DEBUG   ] Got command BAM from MCS: ref #671176
2018-11-29 23:38:29 [INFO    ] Finished processing BAM request
2018-11-29 23:38:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671176   8 58451 85109037 A  ERROR'
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:38:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:38:30 [DEBUG   ] spawn_process: at 2018-11-29 23:38:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:38:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:38:36 [DEBUG   ] Got command BAM from MCS: ref #671178
2018-11-29 23:38:36 [INFO    ] Finished processing BAM request
2018-11-29 23:38:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671178   8 58451 85116029 A  ERROR'
2018-11-29 23:38:36 [DEBUG   ] Got command BAM from MCS: ref #671179
2018-11-29 23:38:36 [INFO    ] Finished processing BAM request
2018-11-29 23:38:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671179   8 58451 85116033 A  ERROR'
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:38:36 [DEBUG   ] spawn_process: at 2018-11-29 23:38:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:38:43 [DEBUG   ] Got command BAM from MCS: ref #671180
2018-11-29 23:38:43 [INFO    ] Finished processing BAM request
2018-11-29 23:38:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671180   8 58451 85123033 A  ERROR'
2018-11-29 23:38:43 [DEBUG   ] Got command BAM from MCS: ref #671181
2018-11-29 23:38:43 [INFO    ] Finished processing BAM request
2018-11-29 23:38:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671181   8 58451 85123037 A  ERROR'
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:38:43 [DEBUG   ] spawn_process: at 2018-11-29 23:38:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:38:50 [DEBUG   ] Got command BAM from MCS: ref #671183
2018-11-29 23:38:50 [INFO    ] Finished processing BAM request
2018-11-29 23:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671183   8 58451 85130025 A  ERROR'
2018-11-29 23:38:50 [DEBUG   ] Got command BAM from MCS: ref #671182
2018-11-29 23:38:50 [INFO    ] Finished processing BAM request
2018-11-29 23:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671182   8 58451 85130029 A  ERROR'
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:38:50 [DEBUG   ] spawn_process: at 2018-11-29 23:38:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:38:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:38:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:38:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:38:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:38:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:38:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:38:54 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-11-29 23:38:57 [DEBUG   ] Got command BAM from MCS: ref #671185
2018-11-29 23:38:57 [INFO    ] Finished processing BAM request
2018-11-29 23:38:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671185   8 58451 85137025 A  ERROR'
2018-11-29 23:38:57 [DEBUG   ] Got command BAM from MCS: ref #671184
2018-11-29 23:38:57 [INFO    ] Finished processing BAM request
2018-11-29 23:38:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:38:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671184   8 58451 85137029 A  ERROR'
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:38:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:38:57 [DEBUG   ] spawn_process: at 2018-11-29 23:38:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:39:04 [DEBUG   ] Got command BAM from MCS: ref #671186
2018-11-29 23:39:04 [INFO    ] Finished processing BAM request
2018-11-29 23:39:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671186   8 58451 85144037 A  ERROR'
2018-11-29 23:39:04 [DEBUG   ] Got command BAM from MCS: ref #671187
2018-11-29 23:39:04 [INFO    ] Finished processing BAM request
2018-11-29 23:39:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671187   8 58451 85144041 A  ERROR'
2018-11-29 23:39:04 [DEBUG   ] Got command RPT from MCS: ref #671188
2018-11-29 23:39:04 [DEBUG   ] summary = ERROR
2018-11-29 23:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671188  13 58451 85144521 A  ERRORERROR'
2018-11-29 23:39:04 [DEBUG   ] Got command RPT from MCS: ref #671189
2018-11-29 23:39:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671189  77 58451 85144725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:39:04 [DEBUG   ] Got command RPT from MCS: ref #671190
2018-11-29 23:39:04 [DEBUG   ] summary = ERROR
2018-11-29 23:39:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671190  13 58451 85144926 A  ERRORERROR'
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:39:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:39:04 [DEBUG   ] spawn_process: at 2018-11-29 23:39:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:39:05 [DEBUG   ] Got command RPT from MCS: ref #671191
2018-11-29 23:39:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671191  77 58451 85145117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:39:05 [DEBUG   ] Got command RPT from MCS: ref #671192
2018-11-29 23:39:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671192  12 58451 85145328 A  ERRORB£ff'
2018-11-29 23:39:11 [DEBUG   ] Got command BAM from MCS: ref #671193
2018-11-29 23:39:11 [INFO    ] Finished processing BAM request
2018-11-29 23:39:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671193   8 58451 85151033 A  ERROR'
2018-11-29 23:39:11 [DEBUG   ] Got command BAM from MCS: ref #671194
2018-11-29 23:39:11 [INFO    ] Finished processing BAM request
2018-11-29 23:39:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671194   8 58451 85151037 A  ERROR'
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:39:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:39:11 [DEBUG   ] spawn_process: at 2018-11-29 23:39:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:39:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:39:18 [DEBUG   ] Got command BAM from MCS: ref #671195
2018-11-29 23:39:18 [INFO    ] Finished processing BAM request
2018-11-29 23:39:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671195   8 58451 85158041 A  ERROR'
2018-11-29 23:39:18 [DEBUG   ] Got command BAM from MCS: ref #671196
2018-11-29 23:39:18 [INFO    ] Finished processing BAM request
2018-11-29 23:39:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671196   8 58451 85158045 A  ERROR'
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:39:18 [DEBUG   ] spawn_process: at 2018-11-29 23:39:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:39:25 [DEBUG   ] Got command BAM from MCS: ref #671197
2018-11-29 23:39:25 [INFO    ] Finished processing BAM request
2018-11-29 23:39:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671197   8 58451 85165025 A  ERROR'
2018-11-29 23:39:25 [DEBUG   ] Got command BAM from MCS: ref #671198
2018-11-29 23:39:25 [INFO    ] Finished processing BAM request
2018-11-29 23:39:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671198   8 58451 85165029 A  ERROR'
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:39:25 [DEBUG   ] spawn_process: at 2018-11-29 23:39:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:39:32 [DEBUG   ] Got command BAM from MCS: ref #671199
2018-11-29 23:39:32 [INFO    ] Finished processing BAM request
2018-11-29 23:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671199   8 58451 85172029 A  ERROR'
2018-11-29 23:39:32 [DEBUG   ] Got command BAM from MCS: ref #671200
2018-11-29 23:39:32 [INFO    ] Finished processing BAM request
2018-11-29 23:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671200   8 58451 85172033 A  ERROR'
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:39:32 [DEBUG   ] spawn_process: at 2018-11-29 23:39:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:39:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:39:39 [DEBUG   ] Got command BAM from MCS: ref #671201
2018-11-29 23:39:39 [INFO    ] Finished processing BAM request
2018-11-29 23:39:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671201   8 58451 85179037 A  ERROR'
2018-11-29 23:39:39 [DEBUG   ] Got command BAM from MCS: ref #671202
2018-11-29 23:39:39 [INFO    ] Finished processing BAM request
2018-11-29 23:39:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671202   8 58451 85179041 A  ERROR'
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:39:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:39:39 [DEBUG   ] spawn_process: at 2018-11-29 23:39:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:39:46 [DEBUG   ] Got command BAM from MCS: ref #671204
2018-11-29 23:39:46 [INFO    ] Finished processing BAM request
2018-11-29 23:39:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671204   8 58451 85186033 A  ERROR'
2018-11-29 23:39:46 [DEBUG   ] Got command BAM from MCS: ref #671203
2018-11-29 23:39:46 [INFO    ] Finished processing BAM request
2018-11-29 23:39:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671203   8 58451 85186037 A  ERROR'
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:39:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:39:46 [DEBUG   ] spawn_process: at 2018-11-29 23:39:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:39:53 [DEBUG   ] Got command BAM from MCS: ref #671206
2018-11-29 23:39:53 [INFO    ] Finished processing BAM request
2018-11-29 23:39:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671206   8 58451 85193049 A  ERROR'
2018-11-29 23:39:53 [DEBUG   ] Got command BAM from MCS: ref #671205
2018-11-29 23:39:53 [INFO    ] Finished processing BAM request
2018-11-29 23:39:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671205   8 58451 85193057 A  ERROR'
2018-11-29 23:39:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:39:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:39:53 [DEBUG   ] spawn_process: at 2018-11-29 23:39:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:39:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:39:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:39:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:39:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:39:54 [WARNING ] (13, 1, 'bot')
2018-11-29 23:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:39:54 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-29 23:40:00 [DEBUG   ] Got command BAM from MCS: ref #671208
2018-11-29 23:40:00 [INFO    ] Finished processing BAM request
2018-11-29 23:40:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671208   8 58451 85200025 A  ERROR'
2018-11-29 23:40:00 [DEBUG   ] Got command BAM from MCS: ref #671207
2018-11-29 23:40:00 [INFO    ] Finished processing BAM request
2018-11-29 23:40:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671207   8 58451 85200029 A  ERROR'
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:40:00 [DEBUG   ] spawn_process: at 2018-11-29 23:40:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:40:07 [DEBUG   ] Got command BAM from MCS: ref #671209
2018-11-29 23:40:07 [INFO    ] Finished processing BAM request
2018-11-29 23:40:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671209   8 58451 85207029 A  ERROR'
2018-11-29 23:40:07 [DEBUG   ] Got command BAM from MCS: ref #671210
2018-11-29 23:40:07 [INFO    ] Finished processing BAM request
2018-11-29 23:40:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671210   8 58451 85207033 A  ERROR'
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:40:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:40:07 [DEBUG   ] spawn_process: at 2018-11-29 23:40:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:40:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 23:40:14 [DEBUG   ] Got command BAM from MCS: ref #671211
2018-11-29 23:40:14 [INFO    ] Finished processing BAM request
2018-11-29 23:40:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671211   8 58451 85214041 A  ERROR'
2018-11-29 23:40:14 [DEBUG   ] Got command BAM from MCS: ref #671212
2018-11-29 23:40:14 [INFO    ] Finished processing BAM request
2018-11-29 23:40:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671212   8 58451 85214045 A  ERROR'
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:40:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:40:14 [DEBUG   ] spawn_process: at 2018-11-29 23:40:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:40:21 [DEBUG   ] Got command BAM from MCS: ref #671214
2018-11-29 23:40:21 [INFO    ] Finished processing BAM request
2018-11-29 23:40:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671214   8 58451 85221029 A  ERROR'
2018-11-29 23:40:21 [DEBUG   ] Got command BAM from MCS: ref #671213
2018-11-29 23:40:21 [INFO    ] Finished processing BAM request
2018-11-29 23:40:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671213   8 58451 85221033 A  ERROR'
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:40:21 [DEBUG   ] spawn_process: at 2018-11-29 23:40:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:40:28 [DEBUG   ] Got command BAM from MCS: ref #671215
2018-11-29 23:40:28 [INFO    ] Finished processing BAM request
2018-11-29 23:40:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671215   8 58451 85228033 A  ERROR'
2018-11-29 23:40:28 [DEBUG   ] Got command BAM from MCS: ref #671216
2018-11-29 23:40:28 [INFO    ] Finished processing BAM request
2018-11-29 23:40:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671216   8 58451 85228037 A  ERROR'
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:40:28 [DEBUG   ] spawn_process: at 2018-11-29 23:40:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:40:33 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-29 23:40:35 [DEBUG   ] Got command BAM from MCS: ref #671218
2018-11-29 23:40:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671218   8 58451 85235033 A  ERROR'
2018-11-29 23:40:35 [DEBUG   ] Got command BAM from MCS: ref #671217
2018-11-29 23:40:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671217   8 58451 85235037 A  ERROR'
2018-11-29 23:40:35 [INFO    ] Finished processing BAM request
2018-11-29 23:40:35 [INFO    ] Finished processing BAM request
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:40:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:40:35 [DEBUG   ] spawn_process: at 2018-11-29 23:40:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:40:42 [DEBUG   ] Got command BAM from MCS: ref #671219
2018-11-29 23:40:42 [INFO    ] Finished processing BAM request
2018-11-29 23:40:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671219   8 58451 85242029 A  ERROR'
2018-11-29 23:40:42 [DEBUG   ] Got command BAM from MCS: ref #671220
2018-11-29 23:40:42 [INFO    ] Finished processing BAM request
2018-11-29 23:40:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671220   8 58451 85242033 A  ERROR'
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:40:42 [DEBUG   ] spawn_process: at 2018-11-29 23:40:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:40:49 [DEBUG   ] Got command BAM from MCS: ref #671221
2018-11-29 23:40:49 [INFO    ] Finished processing BAM request
2018-11-29 23:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671221   8 58451 85249037 A  ERROR'
2018-11-29 23:40:49 [DEBUG   ] Got command BAM from MCS: ref #671222
2018-11-29 23:40:49 [INFO    ] Finished processing BAM request
2018-11-29 23:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671222   8 58451 85249041 A  ERROR'
2018-11-29 23:40:49 [DEBUG   ] Got command RPT from MCS: ref #671223
2018-11-29 23:40:49 [DEBUG   ] summary = ERROR
2018-11-29 23:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671223  13 58451 85249833 A  ERRORERROR'
2018-11-29 23:40:49 [DEBUG   ] Got command RPT from MCS: ref #671224
2018-11-29 23:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671224  77 58451 85249834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:40:49 [DEBUG   ] spawn_process: at 2018-11-29 23:40:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:40:54 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2018-11-29 23:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 23:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 23:40:55 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:40:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:40:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:40:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:40:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:40:55 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-29 23:40:56 [DEBUG   ] Got command BAM from MCS: ref #671240
2018-11-29 23:40:56 [INFO    ] Finished processing BAM request
2018-11-29 23:40:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671240   8 58451 85256033 A  ERROR'
2018-11-29 23:40:56 [DEBUG   ] Got command BAM from MCS: ref #671241
2018-11-29 23:40:56 [INFO    ] Finished processing BAM request
2018-11-29 23:40:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671241   8 58451 85256037 A  ERROR'
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:40:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:40:56 [DEBUG   ] spawn_process: at 2018-11-29 23:40:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:41:03 [DEBUG   ] Got command BAM from MCS: ref #671242
2018-11-29 23:41:03 [INFO    ] Finished processing BAM request
2018-11-29 23:41:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671242   8 58451 85263025 A  ERROR'
2018-11-29 23:41:03 [DEBUG   ] Got command BAM from MCS: ref #671243
2018-11-29 23:41:03 [INFO    ] Finished processing BAM request
2018-11-29 23:41:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671243   8 58451 85263029 A  ERROR'
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:41:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:41:03 [DEBUG   ] spawn_process: at 2018-11-29 23:41:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:41:10 [DEBUG   ] Got command BAM from MCS: ref #671245
2018-11-29 23:41:10 [INFO    ] Finished processing BAM request
2018-11-29 23:41:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671245   8 58451 85270033 A  ERROR'
2018-11-29 23:41:10 [DEBUG   ] Got command BAM from MCS: ref #671244
2018-11-29 23:41:10 [INFO    ] Finished processing BAM request
2018-11-29 23:41:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671244   8 58451 85270037 A  ERROR'
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:41:10 [DEBUG   ] spawn_process: at 2018-11-29 23:41:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:41:14 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2018-11-29 23:41:17 [DEBUG   ] Got command BAM from MCS: ref #671246
2018-11-29 23:41:17 [INFO    ] Finished processing BAM request
2018-11-29 23:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671246   8 58451 85277025 A  ERROR'
2018-11-29 23:41:17 [DEBUG   ] Got command BAM from MCS: ref #671247
2018-11-29 23:41:17 [INFO    ] Finished processing BAM request
2018-11-29 23:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671247   8 58451 85277029 A  ERROR'
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:41:17 [DEBUG   ] spawn_process: at 2018-11-29 23:41:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:41:24 [DEBUG   ] Got command BAM from MCS: ref #671252
2018-11-29 23:41:24 [INFO    ] Finished processing BAM request
2018-11-29 23:41:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671252   8 58451 85284029 A  ERROR'
2018-11-29 23:41:24 [DEBUG   ] Got command BAM from MCS: ref #671253
2018-11-29 23:41:24 [INFO    ] Finished processing BAM request
2018-11-29 23:41:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671253   8 58451 85284033 A  ERROR'
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:41:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:41:24 [DEBUG   ] spawn_process: at 2018-11-29 23:41:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:41:31 [DEBUG   ] Got command BAM from MCS: ref #671255
2018-11-29 23:41:31 [INFO    ] Finished processing BAM request
2018-11-29 23:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671255   8 58451 85291033 A  ERROR'
2018-11-29 23:41:31 [DEBUG   ] Got command BAM from MCS: ref #671254
2018-11-29 23:41:31 [INFO    ] Finished processing BAM request
2018-11-29 23:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671254   8 58451 85291037 A  ERROR'
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:41:31 [DEBUG   ] spawn_process: at 2018-11-29 23:41:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:41:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:41:38 [DEBUG   ] Got command BAM from MCS: ref #671257
2018-11-29 23:41:38 [INFO    ] Finished processing BAM request
2018-11-29 23:41:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671257   8 58451 85298029 A  ERROR'
2018-11-29 23:41:38 [DEBUG   ] Got command BAM from MCS: ref #671256
2018-11-29 23:41:38 [INFO    ] Finished processing BAM request
2018-11-29 23:41:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671256   8 58451 85298033 A  ERROR'
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:41:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:41:38 [DEBUG   ] spawn_process: at 2018-11-29 23:41:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:41:45 [DEBUG   ] Got command BAM from MCS: ref #671258
2018-11-29 23:41:45 [INFO    ] Finished processing BAM request
2018-11-29 23:41:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671258   8 58451 85305025 A  ERROR'
2018-11-29 23:41:45 [DEBUG   ] Got command BAM from MCS: ref #671259
2018-11-29 23:41:45 [INFO    ] Finished processing BAM request
2018-11-29 23:41:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671259   8 58451 85305029 A  ERROR'
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:41:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:41:45 [DEBUG   ] spawn_process: at 2018-11-29 23:41:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:41:52 [DEBUG   ] Got command BAM from MCS: ref #671260
2018-11-29 23:41:52 [INFO    ] Finished processing BAM request
2018-11-29 23:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671260   8 58451 85312033 A  ERROR'
2018-11-29 23:41:52 [DEBUG   ] Got command BAM from MCS: ref #671261
2018-11-29 23:41:52 [INFO    ] Finished processing BAM request
2018-11-29 23:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671261   8 58451 85312037 A  ERROR'
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:41:52 [DEBUG   ] spawn_process: at 2018-11-29 23:41:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:41:54 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-11-29 23:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 23:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:41:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:41:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 23:41:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:41:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:41:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:41:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:41:55 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-29 23:41:59 [DEBUG   ] Got command BAM from MCS: ref #671263
2018-11-29 23:41:59 [INFO    ] Finished processing BAM request
2018-11-29 23:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671263   8 58451 85319033 A  ERROR'
2018-11-29 23:41:59 [DEBUG   ] Got command BAM from MCS: ref #671262
2018-11-29 23:41:59 [INFO    ] Finished processing BAM request
2018-11-29 23:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671262   8 58451 85319037 A  ERROR'
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:41:59 [DEBUG   ] spawn_process: at 2018-11-29 23:41:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:42:06 [DEBUG   ] Got command BAM from MCS: ref #671264
2018-11-29 23:42:06 [INFO    ] Finished processing BAM request
2018-11-29 23:42:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671264   8 58451 85326029 A  ERROR'
2018-11-29 23:42:06 [DEBUG   ] Got command BAM from MCS: ref #671265
2018-11-29 23:42:06 [INFO    ] Finished processing BAM request
2018-11-29 23:42:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671265   8 58451 85326033 A  ERROR'
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:42:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:42:06 [DEBUG   ] spawn_process: at 2018-11-29 23:42:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:42:13 [DEBUG   ] Got command BAM from MCS: ref #671267
2018-11-29 23:42:13 [INFO    ] Finished processing BAM request
2018-11-29 23:42:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671267   8 58451 85333033 A  ERROR'
2018-11-29 23:42:13 [DEBUG   ] Got command BAM from MCS: ref #671266
2018-11-29 23:42:13 [INFO    ] Finished processing BAM request
2018-11-29 23:42:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671266   8 58451 85333037 A  ERROR'
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:42:13 [DEBUG   ] spawn_process: at 2018-11-29 23:42:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:42:14 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-11-29 23:42:20 [DEBUG   ] Got command BAM from MCS: ref #671269
2018-11-29 23:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671269   8 58451 85340098 A  ERROR'
2018-11-29 23:42:20 [DEBUG   ] Got command BAM from MCS: ref #671268
2018-11-29 23:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671268   8 58451 85340102 A  ERROR'
2018-11-29 23:42:20 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-29 23:42:20 [INFO    ] Finished processing BAM request
2018-11-29 23:42:20 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-29 23:42:20 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-29 23:42:20 [INFO    ] Finished processing BAM request
2018-11-29 23:42:20 [DEBUG   ] 
2018-11-29 23:42:27 [DEBUG   ] Got command BAM from MCS: ref #671270
2018-11-29 23:42:27 [INFO    ] Finished processing BAM request
2018-11-29 23:42:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671270   8 58451 85347030 A  ERROR'
2018-11-29 23:42:27 [DEBUG   ] Got command BAM from MCS: ref #671271
2018-11-29 23:42:27 [INFO    ] Finished processing BAM request
2018-11-29 23:42:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671271   8 58451 85347034 A  ERROR'
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:42:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:42:27 [DEBUG   ] spawn_process: at 2018-11-29 23:42:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:42:34 [DEBUG   ] Got command BAM from MCS: ref #671273
2018-11-29 23:42:34 [INFO    ] Finished processing BAM request
2018-11-29 23:42:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671273   8 58451 85354034 A  ERROR'
2018-11-29 23:42:34 [DEBUG   ] Got command BAM from MCS: ref #671272
2018-11-29 23:42:34 [INFO    ] Finished processing BAM request
2018-11-29 23:42:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671272   8 58451 85354038 A  ERROR'
2018-11-29 23:42:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:42:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:42:34 [DEBUG   ] spawn_process: at 2018-11-29 23:42:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:42:41 [DEBUG   ] Got command BAM from MCS: ref #671274
2018-11-29 23:42:41 [INFO    ] Finished processing BAM request
2018-11-29 23:42:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671274   8 58451 85361026 A  ERROR'
2018-11-29 23:42:41 [DEBUG   ] Got command BAM from MCS: ref #671275
2018-11-29 23:42:41 [INFO    ] Finished processing BAM request
2018-11-29 23:42:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671275   8 58451 85361030 A  ERROR'
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:42:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:42:41 [DEBUG   ] spawn_process: at 2018-11-29 23:42:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:42:48 [DEBUG   ] Got command BAM from MCS: ref #671277
2018-11-29 23:42:48 [INFO    ] Finished processing BAM request
2018-11-29 23:42:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671277   8 58451 85368029 A  ERROR'
2018-11-29 23:42:48 [DEBUG   ] Got command BAM from MCS: ref #671276
2018-11-29 23:42:48 [INFO    ] Finished processing BAM request
2018-11-29 23:42:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671276   8 58451 85368033 A  ERROR'
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:42:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:42:48 [DEBUG   ] spawn_process: at 2018-11-29 23:42:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:42:54 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2018-11-29 23:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:42:55 [DEBUG   ] Got command BAM from MCS: ref #671278
2018-11-29 23:42:55 [INFO    ] Finished processing BAM request
2018-11-29 23:42:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671278   8 58451 85375025 A  ERROR'
2018-11-29 23:42:55 [DEBUG   ] Got command BAM from MCS: ref #671279
2018-11-29 23:42:55 [INFO    ] Finished processing BAM request
2018-11-29 23:42:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671279   8 58451 85375029 A  ERROR'
2018-11-29 23:42:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:42:55 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:42:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:42:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:42:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:42:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:42:55 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:42:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:42:55 [DEBUG   ] spawn_process: at 2018-11-29 23:42:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:43:02 [DEBUG   ] Got command BAM from MCS: ref #671281
2018-11-29 23:43:02 [INFO    ] Finished processing BAM request
2018-11-29 23:43:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671281   8 58451 85382025 A  ERROR'
2018-11-29 23:43:02 [DEBUG   ] Got command BAM from MCS: ref #671280
2018-11-29 23:43:02 [INFO    ] Finished processing BAM request
2018-11-29 23:43:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671280   8 58451 85382029 A  ERROR'
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:43:02 [DEBUG   ] spawn_process: at 2018-11-29 23:43:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:43:08 [DEBUG   ] Got command BAM from MCS: ref #671282
2018-11-29 23:43:08 [INFO    ] Finished processing BAM request
2018-11-29 23:43:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671282   8 58451 85388033 A  ERROR'
2018-11-29 23:43:08 [DEBUG   ] Got command BAM from MCS: ref #671283
2018-11-29 23:43:08 [INFO    ] Finished processing BAM request
2018-11-29 23:43:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671283   8 58451 85388037 A  ERROR'
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:43:08 [DEBUG   ] spawn_process: at 2018-11-29 23:43:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:43:14 [DEBUG   ] Got command BAM from MCS: ref #671285
2018-11-29 23:43:14 [INFO    ] Finished processing BAM request
2018-11-29 23:43:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671285   8 58451 85394025 A  ERROR'
2018-11-29 23:43:14 [DEBUG   ] Got command BAM from MCS: ref #671284
2018-11-29 23:43:14 [INFO    ] Finished processing BAM request
2018-11-29 23:43:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671284   8 58451 85394029 A  ERROR'
2018-11-29 23:43:14 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:43:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:43:14 [DEBUG   ] spawn_process: at 2018-11-29 23:43:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:43:20 [DEBUG   ] Got command BAM from MCS: ref #671286
2018-11-29 23:43:20 [INFO    ] Finished processing BAM request
2018-11-29 23:43:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671286   8 58451 85400025 A  ERROR'
2018-11-29 23:43:20 [DEBUG   ] Got command BAM from MCS: ref #671287
2018-11-29 23:43:20 [INFO    ] Finished processing BAM request
2018-11-29 23:43:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671287   8 58451 85400029 A  ERROR'
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:43:20 [DEBUG   ] spawn_process: at 2018-11-29 23:43:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:43:26 [DEBUG   ] Got command BAM from MCS: ref #671288
2018-11-29 23:43:26 [INFO    ] Finished processing BAM request
2018-11-29 23:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671288   8 58451 85406033 A  ERROR'
2018-11-29 23:43:26 [DEBUG   ] Got command BAM from MCS: ref #671289
2018-11-29 23:43:26 [INFO    ] Finished processing BAM request
2018-11-29 23:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671289   8 58451 85406037 A  ERROR'
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:43:26 [DEBUG   ] spawn_process: at 2018-11-29 23:43:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:43:32 [DEBUG   ] Got command BAM from MCS: ref #671291
2018-11-29 23:43:32 [INFO    ] Finished processing BAM request
2018-11-29 23:43:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671291   8 58451 85412029 A  ERROR'
2018-11-29 23:43:32 [DEBUG   ] Got command BAM from MCS: ref #671290
2018-11-29 23:43:32 [INFO    ] Finished processing BAM request
2018-11-29 23:43:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671290   8 58451 85412033 A  ERROR'
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:43:32 [DEBUG   ] spawn_process: at 2018-11-29 23:43:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:43:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-29 23:43:38 [DEBUG   ] Got command BAM from MCS: ref #671292
2018-11-29 23:43:38 [INFO    ] Finished processing BAM request
2018-11-29 23:43:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671292   8 58451 85418025 A  ERROR'
2018-11-29 23:43:38 [DEBUG   ] Got command BAM from MCS: ref #671293
2018-11-29 23:43:38 [INFO    ] Finished processing BAM request
2018-11-29 23:43:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671293   8 58451 85418029 A  ERROR'
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:43:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:43:38 [DEBUG   ] spawn_process: at 2018-11-29 23:43:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:43:44 [DEBUG   ] Got command BAM from MCS: ref #671297
2018-11-29 23:43:44 [INFO    ] Finished processing BAM request
2018-11-29 23:43:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671297   8 58451 85424033 A  ERROR'
2018-11-29 23:43:44 [DEBUG   ] Got command BAM from MCS: ref #671296
2018-11-29 23:43:44 [INFO    ] Finished processing BAM request
2018-11-29 23:43:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671296   8 58451 85424037 A  ERROR'
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:43:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:43:44 [DEBUG   ] spawn_process: at 2018-11-29 23:43:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:43:50 [DEBUG   ] Got command BAM from MCS: ref #671298
2018-11-29 23:43:50 [INFO    ] Finished processing BAM request
2018-11-29 23:43:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671298   8 58451 85430029 A  ERROR'
2018-11-29 23:43:50 [DEBUG   ] Got command BAM from MCS: ref #671299
2018-11-29 23:43:50 [INFO    ] Finished processing BAM request
2018-11-29 23:43:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671299   8 58451 85430033 A  ERROR'
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:43:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:43:50 [DEBUG   ] spawn_process: at 2018-11-29 23:43:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:43:54 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2018-11-29 23:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-29 23:43:55 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:43:55 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:43:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:43:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:43:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:43:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:43:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:43:55 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-29 23:43:56 [DEBUG   ] Got command BAM from MCS: ref #671300
2018-11-29 23:43:56 [INFO    ] Finished processing BAM request
2018-11-29 23:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671300   8 58451 85436029 A  ERROR'
2018-11-29 23:43:56 [DEBUG   ] Got command BAM from MCS: ref #671301
2018-11-29 23:43:56 [INFO    ] Finished processing BAM request
2018-11-29 23:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671301   8 58451 85436033 A  ERROR'
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:43:56 [DEBUG   ] spawn_process: at 2018-11-29 23:43:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:44:02 [DEBUG   ] Got command BAM from MCS: ref #671302
2018-11-29 23:44:02 [INFO    ] Finished processing BAM request
2018-11-29 23:44:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671302   8 58451 85442025 A  ERROR'
2018-11-29 23:44:02 [DEBUG   ] Got command BAM from MCS: ref #671303
2018-11-29 23:44:02 [INFO    ] Finished processing BAM request
2018-11-29 23:44:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671303   8 58451 85442029 A  ERROR'
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:44:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:44:02 [DEBUG   ] spawn_process: at 2018-11-29 23:44:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:44:04 [DEBUG   ] Got command RPT from MCS: ref #671304
2018-11-29 23:44:04 [DEBUG   ] summary = ERROR
2018-11-29 23:44:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671304  13 58451 85444601 A  ERRORERROR'
2018-11-29 23:44:04 [DEBUG   ] Got command RPT from MCS: ref #671305
2018-11-29 23:44:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:44:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671305  77 58451 85444805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:44:05 [DEBUG   ] Got command RPT from MCS: ref #671306
2018-11-29 23:44:05 [DEBUG   ] summary = ERROR
2018-11-29 23:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671306  13 58451 85445009 A  ERRORERROR'
2018-11-29 23:44:05 [DEBUG   ] Got command RPT from MCS: ref #671308
2018-11-29 23:44:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671308  77 58451 85445201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:44:05 [DEBUG   ] Got command RPT from MCS: ref #671310
2018-11-29 23:44:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671310  12 58451 85445405 A  ERRORB¤ff'
2018-11-29 23:44:08 [DEBUG   ] Got command BAM from MCS: ref #671315
2018-11-29 23:44:08 [INFO    ] Finished processing BAM request
2018-11-29 23:44:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671315   8 58451 85448025 A  ERROR'
2018-11-29 23:44:08 [DEBUG   ] Got command BAM from MCS: ref #671314
2018-11-29 23:44:08 [INFO    ] Finished processing BAM request
2018-11-29 23:44:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671314   8 58451 85448029 A  ERROR'
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:44:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:44:08 [DEBUG   ] spawn_process: at 2018-11-29 23:44:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:44:14 [DEBUG   ] Got command BAM from MCS: ref #671317
2018-11-29 23:44:14 [INFO    ] Finished processing BAM request
2018-11-29 23:44:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671317   8 58451 85454025 A  ERROR'
2018-11-29 23:44:14 [DEBUG   ] Got command BAM from MCS: ref #671316
2018-11-29 23:44:14 [INFO    ] Finished processing BAM request
2018-11-29 23:44:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671316   8 58451 85454029 A  ERROR'
2018-11-29 23:44:14 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2018-11-29 23:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:44:14 [DEBUG   ] spawn_process: at 2018-11-29 23:44:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:44:15 [DEBUG   ] spawn_process: at 2018-11-29 23:44:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:44:20 [DEBUG   ] Got command BAM from MCS: ref #671322
2018-11-29 23:44:20 [INFO    ] Finished processing BAM request
2018-11-29 23:44:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671322   8 58451 85460033 A  ERROR'
2018-11-29 23:44:20 [DEBUG   ] Got command BAM from MCS: ref #671323
2018-11-29 23:44:20 [INFO    ] Finished processing BAM request
2018-11-29 23:44:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671323   8 58451 85460037 A  ERROR'
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:44:20 [DEBUG   ] spawn_process: at 2018-11-29 23:44:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:44:26 [DEBUG   ] Got command BAM from MCS: ref #671325
2018-11-29 23:44:26 [INFO    ] Finished processing BAM request
2018-11-29 23:44:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671325   8 58451 85466029 A  ERROR'
2018-11-29 23:44:26 [DEBUG   ] Got command BAM from MCS: ref #671324
2018-11-29 23:44:26 [INFO    ] Finished processing BAM request
2018-11-29 23:44:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671324   8 58451 85466033 A  ERROR'
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:44:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:44:26 [DEBUG   ] spawn_process: at 2018-11-29 23:44:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:44:32 [DEBUG   ] Got command BAM from MCS: ref #671326
2018-11-29 23:44:32 [INFO    ] Finished processing BAM request
2018-11-29 23:44:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671326   8 58451 85472025 A  ERROR'
2018-11-29 23:44:32 [DEBUG   ] Got command BAM from MCS: ref #671327
2018-11-29 23:44:32 [INFO    ] Finished processing BAM request
2018-11-29 23:44:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671327   8 58451 85472029 A  ERROR'
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:44:32 [DEBUG   ] spawn_process: at 2018-11-29 23:44:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:44:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:44:38 [DEBUG   ] Got command BAM from MCS: ref #671329
2018-11-29 23:44:38 [INFO    ] Finished processing BAM request
2018-11-29 23:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671329   8 58451 85478033 A  ERROR'
2018-11-29 23:44:38 [DEBUG   ] Got command BAM from MCS: ref #671328
2018-11-29 23:44:38 [INFO    ] Finished processing BAM request
2018-11-29 23:44:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671328   8 58451 85478037 A  ERROR'
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:44:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:44:38 [DEBUG   ] spawn_process: at 2018-11-29 23:44:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:44:44 [DEBUG   ] Got command BAM from MCS: ref #671331
2018-11-29 23:44:44 [INFO    ] Finished processing BAM request
2018-11-29 23:44:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671331   8 58451 85484033 A  ERROR'
2018-11-29 23:44:44 [DEBUG   ] Got command BAM from MCS: ref #671330
2018-11-29 23:44:44 [INFO    ] Finished processing BAM request
2018-11-29 23:44:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671330   8 58451 85484037 A  ERROR'
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:44:44 [DEBUG   ] spawn_process: at 2018-11-29 23:44:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:44:50 [DEBUG   ] Got command BAM from MCS: ref #671333
2018-11-29 23:44:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671333   8 58451 85490025 A  ERROR'
2018-11-29 23:44:50 [DEBUG   ] Got command BAM from MCS: ref #671332
2018-11-29 23:44:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671332   8 58451 85490029 A  ERROR'
2018-11-29 23:44:50 [INFO    ] Finished processing BAM request
2018-11-29 23:44:50 [INFO    ] Finished processing BAM request
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:44:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:44:50 [DEBUG   ] spawn_process: at 2018-11-29 23:44:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:44:55 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-11-29 23:44:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 23:44:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:44:56 [DEBUG   ] Got command BAM from MCS: ref #671334
2018-11-29 23:44:56 [INFO    ] Finished processing BAM request
2018-11-29 23:44:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671334   8 58451 85496033 A  ERROR'
2018-11-29 23:44:56 [DEBUG   ] Got command BAM from MCS: ref #671335
2018-11-29 23:44:56 [INFO    ] Finished processing BAM request
2018-11-29 23:44:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671335   8 58451 85496037 A  ERROR'
2018-11-29 23:44:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 23:44:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:44:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:44:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 23:44:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:44:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:44:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:44:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:44:56 [DEBUG   ] Finished updating board flags in 2.380 seconds
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:44:56 [DEBUG   ] spawn_process: at 2018-11-29 23:44:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:45:02 [DEBUG   ] Got command BAM from MCS: ref #671336
2018-11-29 23:45:02 [INFO    ] Finished processing BAM request
2018-11-29 23:45:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671336   8 58451 85502033 A  ERROR'
2018-11-29 23:45:02 [DEBUG   ] Got command BAM from MCS: ref #671337
2018-11-29 23:45:02 [INFO    ] Finished processing BAM request
2018-11-29 23:45:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671337   8 58451 85502037 A  ERROR'
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:45:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:45:02 [DEBUG   ] spawn_process: at 2018-11-29 23:45:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:45:08 [DEBUG   ] Got command BAM from MCS: ref #671339
2018-11-29 23:45:08 [INFO    ] Finished processing BAM request
2018-11-29 23:45:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671339   8 58451 85508033 A  ERROR'
2018-11-29 23:45:08 [DEBUG   ] Got command BAM from MCS: ref #671338
2018-11-29 23:45:08 [INFO    ] Finished processing BAM request
2018-11-29 23:45:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671338   8 58451 85508037 A  ERROR'
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:45:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:45:08 [DEBUG   ] spawn_process: at 2018-11-29 23:45:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:45:14 [DEBUG   ] Got command BAM from MCS: ref #671341
2018-11-29 23:45:14 [INFO    ] Finished processing BAM request
2018-11-29 23:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671341   8 58451 85514041 A  ERROR'
2018-11-29 23:45:14 [DEBUG   ] Got command BAM from MCS: ref #671340
2018-11-29 23:45:14 [INFO    ] Finished processing BAM request
2018-11-29 23:45:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671340   8 58451 85514045 A  ERROR'
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:45:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:45:14 [DEBUG   ] spawn_process: at 2018-11-29 23:45:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:45:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-29 23:45:20 [DEBUG   ] Got command BAM from MCS: ref #671343
2018-11-29 23:45:20 [INFO    ] Finished processing BAM request
2018-11-29 23:45:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671343   8 58451 85520033 A  ERROR'
2018-11-29 23:45:20 [DEBUG   ] Got command BAM from MCS: ref #671342
2018-11-29 23:45:20 [INFO    ] Finished processing BAM request
2018-11-29 23:45:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671342   8 58451 85520037 A  ERROR'
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:45:20 [DEBUG   ] spawn_process: at 2018-11-29 23:45:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:45:26 [DEBUG   ] Got command BAM from MCS: ref #671344
2018-11-29 23:45:26 [INFO    ] Finished processing BAM request
2018-11-29 23:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671344   8 58451 85526033 A  ERROR'
2018-11-29 23:45:26 [DEBUG   ] Got command BAM from MCS: ref #671345
2018-11-29 23:45:26 [INFO    ] Finished processing BAM request
2018-11-29 23:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671345   8 58451 85526037 A  ERROR'
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:45:26 [DEBUG   ] spawn_process: at 2018-11-29 23:45:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:45:32 [DEBUG   ] Got command BAM from MCS: ref #671346
2018-11-29 23:45:32 [INFO    ] Finished processing BAM request
2018-11-29 23:45:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671346   8 58451 85532033 A  ERROR'
2018-11-29 23:45:32 [DEBUG   ] Got command BAM from MCS: ref #671347
2018-11-29 23:45:32 [INFO    ] Finished processing BAM request
2018-11-29 23:45:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671347   8 58451 85532041 A  ERROR'
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:45:32 [DEBUG   ] spawn_process: at 2018-11-29 23:45:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:45:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:45:38 [DEBUG   ] Got command BAM from MCS: ref #671348
2018-11-29 23:45:38 [INFO    ] Finished processing BAM request
2018-11-29 23:45:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671348   8 58451 85538025 A  ERROR'
2018-11-29 23:45:38 [DEBUG   ] Got command BAM from MCS: ref #671349
2018-11-29 23:45:38 [INFO    ] Finished processing BAM request
2018-11-29 23:45:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671349   8 58451 85538029 A  ERROR'
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:45:38 [DEBUG   ] spawn_process: at 2018-11-29 23:45:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:45:44 [DEBUG   ] Got command BAM from MCS: ref #671350
2018-11-29 23:45:44 [INFO    ] Finished processing BAM request
2018-11-29 23:45:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671350   8 58451 85544033 A  ERROR'
2018-11-29 23:45:44 [DEBUG   ] Got command BAM from MCS: ref #671351
2018-11-29 23:45:44 [INFO    ] Finished processing BAM request
2018-11-29 23:45:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671351   8 58451 85544037 A  ERROR'
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:45:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:45:44 [DEBUG   ] spawn_process: at 2018-11-29 23:45:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:45:49 [DEBUG   ] Got command RPT from MCS: ref #671354
2018-11-29 23:45:49 [DEBUG   ] summary = ERROR
2018-11-29 23:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671354  13 58451 85549833 A  ERRORERROR'
2018-11-29 23:45:49 [DEBUG   ] Got command RPT from MCS: ref #671355
2018-11-29 23:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671355  77 58451 85549834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:45:50 [DEBUG   ] Got command BAM from MCS: ref #671352
2018-11-29 23:45:50 [INFO    ] Finished processing BAM request
2018-11-29 23:45:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671352   8 58451 85550029 A  ERROR'
2018-11-29 23:45:50 [DEBUG   ] Got command BAM from MCS: ref #671353
2018-11-29 23:45:50 [INFO    ] Finished processing BAM request
2018-11-29 23:45:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671353   8 58451 85550033 A  ERROR'
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:45:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:45:50 [DEBUG   ] spawn_process: at 2018-11-29 23:45:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 23:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:45:55 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2018-11-29 23:45:55 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:45:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:45:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:45:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:45:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:45:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:45:55 [DEBUG   ] Finished updating board flags in 1.281 seconds
2018-11-29 23:45:56 [DEBUG   ] Got command BAM from MCS: ref #671372
2018-11-29 23:45:56 [INFO    ] Finished processing BAM request
2018-11-29 23:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671372   8 58451 85556033 A  ERROR'
2018-11-29 23:45:56 [DEBUG   ] Got command BAM from MCS: ref #671371
2018-11-29 23:45:56 [INFO    ] Finished processing BAM request
2018-11-29 23:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671371   8 58451 85556037 A  ERROR'
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:45:56 [DEBUG   ] spawn_process: at 2018-11-29 23:45:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:46:02 [DEBUG   ] Got command BAM from MCS: ref #671373
2018-11-29 23:46:02 [INFO    ] Finished processing BAM request
2018-11-29 23:46:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671373   8 58451 85562029 A  ERROR'
2018-11-29 23:46:02 [DEBUG   ] Got command BAM from MCS: ref #671374
2018-11-29 23:46:02 [INFO    ] Finished processing BAM request
2018-11-29 23:46:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671374   8 58451 85562033 A  ERROR'
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:46:02 [DEBUG   ] spawn_process: at 2018-11-29 23:46:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:46:08 [DEBUG   ] Got command BAM from MCS: ref #671375
2018-11-29 23:46:08 [INFO    ] Finished processing BAM request
2018-11-29 23:46:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671375   8 58451 85568029 A  ERROR'
2018-11-29 23:46:08 [DEBUG   ] Got command BAM from MCS: ref #671376
2018-11-29 23:46:08 [INFO    ] Finished processing BAM request
2018-11-29 23:46:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671376   8 58451 85568033 A  ERROR'
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:46:08 [DEBUG   ] spawn_process: at 2018-11-29 23:46:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:46:14 [DEBUG   ] Got command BAM from MCS: ref #671377
2018-11-29 23:46:14 [INFO    ] Finished processing BAM request
2018-11-29 23:46:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671377   8 58451 85574029 A  ERROR'
2018-11-29 23:46:14 [DEBUG   ] Got command BAM from MCS: ref #671378
2018-11-29 23:46:14 [INFO    ] Finished processing BAM request
2018-11-29 23:46:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671378   8 58451 85574033 A  ERROR'
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:46:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:46:14 [DEBUG   ] spawn_process: at 2018-11-29 23:46:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:46:15 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-11-29 23:46:20 [DEBUG   ] Got command BAM from MCS: ref #671379
2018-11-29 23:46:20 [INFO    ] Finished processing BAM request
2018-11-29 23:46:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671379   8 58451 85580033 A  ERROR'
2018-11-29 23:46:20 [DEBUG   ] Got command BAM from MCS: ref #671380
2018-11-29 23:46:20 [INFO    ] Finished processing BAM request
2018-11-29 23:46:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671380   8 58451 85580037 A  ERROR'
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:46:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:46:20 [DEBUG   ] spawn_process: at 2018-11-29 23:46:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:46:26 [DEBUG   ] Got command BAM from MCS: ref #671382
2018-11-29 23:46:26 [INFO    ] Finished processing BAM request
2018-11-29 23:46:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671382   8 58451 85586033 A  ERROR'
2018-11-29 23:46:26 [DEBUG   ] Got command BAM from MCS: ref #671381
2018-11-29 23:46:26 [INFO    ] Finished processing BAM request
2018-11-29 23:46:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671381   8 58451 85586037 A  ERROR'
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:46:26 [DEBUG   ] spawn_process: at 2018-11-29 23:46:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:46:32 [DEBUG   ] Got command BAM from MCS: ref #671383
2018-11-29 23:46:32 [INFO    ] Finished processing BAM request
2018-11-29 23:46:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671383   8 58451 85592025 A  ERROR'
2018-11-29 23:46:32 [DEBUG   ] Got command BAM from MCS: ref #671384
2018-11-29 23:46:32 [INFO    ] Finished processing BAM request
2018-11-29 23:46:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671384   8 58451 85592029 A  ERROR'
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:46:32 [DEBUG   ] spawn_process: at 2018-11-29 23:46:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:46:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 23:46:38 [DEBUG   ] Got command BAM from MCS: ref #671385
2018-11-29 23:46:38 [INFO    ] Finished processing BAM request
2018-11-29 23:46:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671385   8 58451 85598025 A  ERROR'
2018-11-29 23:46:38 [DEBUG   ] Got command BAM from MCS: ref #671386
2018-11-29 23:46:38 [INFO    ] Finished processing BAM request
2018-11-29 23:46:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671386   8 58451 85598029 A  ERROR'
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:46:38 [DEBUG   ] spawn_process: at 2018-11-29 23:46:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:46:44 [DEBUG   ] Got command BAM from MCS: ref #671388
2018-11-29 23:46:44 [INFO    ] Finished processing BAM request
2018-11-29 23:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671388   8 58451 85604025 A  ERROR'
2018-11-29 23:46:44 [DEBUG   ] Got command BAM from MCS: ref #671387
2018-11-29 23:46:44 [INFO    ] Finished processing BAM request
2018-11-29 23:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671387   8 58451 85604029 A  ERROR'
2018-11-29 23:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:46:44 [DEBUG   ] spawn_process: at 2018-11-29 23:46:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:46:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:46:45 [DEBUG   ] spawn_process: at 2018-11-29 23:46:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:46:50 [DEBUG   ] Got command BAM from MCS: ref #671390
2018-11-29 23:46:50 [INFO    ] Finished processing BAM request
2018-11-29 23:46:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671390   8 58451 85610033 A  ERROR'
2018-11-29 23:46:50 [DEBUG   ] Got command BAM from MCS: ref #671389
2018-11-29 23:46:50 [INFO    ] Finished processing BAM request
2018-11-29 23:46:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671389   8 58451 85610037 A  ERROR'
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:46:50 [DEBUG   ] spawn_process: at 2018-11-29 23:46:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-11-29 23:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-29 23:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:46:55 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-29 23:46:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 23:46:55 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:46:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:46:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:46:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:46:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:46:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:46:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:46:55 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-11-29 23:46:56 [DEBUG   ] Got command BAM from MCS: ref #671392
2018-11-29 23:46:56 [INFO    ] Finished processing BAM request
2018-11-29 23:46:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671392   8 58451 85616033 A  ERROR'
2018-11-29 23:46:56 [DEBUG   ] Got command BAM from MCS: ref #671391
2018-11-29 23:46:56 [INFO    ] Finished processing BAM request
2018-11-29 23:46:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671391   8 58451 85616037 A  ERROR'
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:46:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:46:56 [DEBUG   ] spawn_process: at 2018-11-29 23:46:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:47:02 [DEBUG   ] Got command BAM from MCS: ref #671393
2018-11-29 23:47:02 [INFO    ] Finished processing BAM request
2018-11-29 23:47:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671393   8 58451 85622033 A  ERROR'
2018-11-29 23:47:02 [DEBUG   ] Got command BAM from MCS: ref #671394
2018-11-29 23:47:02 [INFO    ] Finished processing BAM request
2018-11-29 23:47:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671394   8 58451 85622037 A  ERROR'
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:47:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:47:02 [DEBUG   ] spawn_process: at 2018-11-29 23:47:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:47:08 [DEBUG   ] Got command BAM from MCS: ref #671395
2018-11-29 23:47:08 [INFO    ] Finished processing BAM request
2018-11-29 23:47:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671395   8 58451 85628029 A  ERROR'
2018-11-29 23:47:08 [DEBUG   ] Got command BAM from MCS: ref #671396
2018-11-29 23:47:08 [INFO    ] Finished processing BAM request
2018-11-29 23:47:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671396   8 58451 85628033 A  ERROR'
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:47:08 [DEBUG   ] spawn_process: at 2018-11-29 23:47:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:47:14 [DEBUG   ] Got command BAM from MCS: ref #671398
2018-11-29 23:47:14 [INFO    ] Finished processing BAM request
2018-11-29 23:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671398   8 58451 85634025 A  ERROR'
2018-11-29 23:47:14 [DEBUG   ] Got command BAM from MCS: ref #671397
2018-11-29 23:47:14 [INFO    ] Finished processing BAM request
2018-11-29 23:47:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671397   8 58451 85634029 A  ERROR'
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:47:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:47:14 [DEBUG   ] spawn_process: at 2018-11-29 23:47:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:47:15 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2018-11-29 23:47:20 [DEBUG   ] Got command BAM from MCS: ref #671403
2018-11-29 23:47:20 [INFO    ] Finished processing BAM request
2018-11-29 23:47:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671403   8 58451 85640033 A  ERROR'
2018-11-29 23:47:20 [DEBUG   ] Got command BAM from MCS: ref #671404
2018-11-29 23:47:20 [INFO    ] Finished processing BAM request
2018-11-29 23:47:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671404   8 58451 85640037 A  ERROR'
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:47:20 [DEBUG   ] spawn_process: at 2018-11-29 23:47:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:47:26 [DEBUG   ] Got command BAM from MCS: ref #671406
2018-11-29 23:47:26 [INFO    ] Finished processing BAM request
2018-11-29 23:47:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671406   8 58451 85646029 A  ERROR'
2018-11-29 23:47:26 [DEBUG   ] Got command BAM from MCS: ref #671405
2018-11-29 23:47:26 [INFO    ] Finished processing BAM request
2018-11-29 23:47:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671405   8 58451 85646033 A  ERROR'
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:47:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:47:26 [DEBUG   ] spawn_process: at 2018-11-29 23:47:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:47:32 [DEBUG   ] Got command BAM from MCS: ref #671407
2018-11-29 23:47:32 [INFO    ] Finished processing BAM request
2018-11-29 23:47:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671407   8 58451 85652033 A  ERROR'
2018-11-29 23:47:32 [DEBUG   ] Got command BAM from MCS: ref #671408
2018-11-29 23:47:32 [INFO    ] Finished processing BAM request
2018-11-29 23:47:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671408   8 58451 85652037 A  ERROR'
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:47:32 [DEBUG   ] spawn_process: at 2018-11-29 23:47:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:47:35 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-29 23:47:38 [DEBUG   ] Got command BAM from MCS: ref #671409
2018-11-29 23:47:38 [INFO    ] Finished processing BAM request
2018-11-29 23:47:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671409   8 58451 85658025 A  ERROR'
2018-11-29 23:47:38 [DEBUG   ] Got command BAM from MCS: ref #671410
2018-11-29 23:47:38 [INFO    ] Finished processing BAM request
2018-11-29 23:47:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671410   8 58451 85658029 A  ERROR'
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:47:38 [DEBUG   ] spawn_process: at 2018-11-29 23:47:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:47:44 [DEBUG   ] Got command BAM from MCS: ref #671412
2018-11-29 23:47:44 [INFO    ] Finished processing BAM request
2018-11-29 23:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671412   8 58451 85664033 A  ERROR'
2018-11-29 23:47:44 [DEBUG   ] Got command BAM from MCS: ref #671411
2018-11-29 23:47:44 [INFO    ] Finished processing BAM request
2018-11-29 23:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671411   8 58451 85664037 A  ERROR'
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:47:44 [DEBUG   ] spawn_process: at 2018-11-29 23:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:47:50 [DEBUG   ] Got command BAM from MCS: ref #671413
2018-11-29 23:47:50 [INFO    ] Finished processing BAM request
2018-11-29 23:47:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671413   8 58451 85670033 A  ERROR'
2018-11-29 23:47:50 [DEBUG   ] Got command BAM from MCS: ref #671414
2018-11-29 23:47:50 [INFO    ] Finished processing BAM request
2018-11-29 23:47:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671414   8 58451 85670037 A  ERROR'
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:47:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:47:50 [DEBUG   ] spawn_process: at 2018-11-29 23:47:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 23:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:47:56 [DEBUG   ] Got command BAM from MCS: ref #671415
2018-11-29 23:47:56 [INFO    ] Finished processing BAM request
2018-11-29 23:47:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671415   8 58451 85676029 A  ERROR'
2018-11-29 23:47:56 [DEBUG   ] Got command BAM from MCS: ref #671416
2018-11-29 23:47:56 [INFO    ] Finished processing BAM request
2018-11-29 23:47:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:47:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671416   8 58451 85676033 A  ERROR'
2018-11-29 23:47:56 [DEBUG   ] Finished updating ant stats in 1.225 seconds
2018-11-29 23:47:56 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:47:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:47:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:47:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:47:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:47:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:47:56 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:47:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:47:56 [DEBUG   ] spawn_process: at 2018-11-29 23:47:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:48:02 [DEBUG   ] Got command BAM from MCS: ref #671417
2018-11-29 23:48:02 [INFO    ] Finished processing BAM request
2018-11-29 23:48:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671417   8 58451 85682029 A  ERROR'
2018-11-29 23:48:02 [DEBUG   ] Got command BAM from MCS: ref #671418
2018-11-29 23:48:02 [INFO    ] Finished processing BAM request
2018-11-29 23:48:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671418   8 58451 85682033 A  ERROR'
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:48:02 [DEBUG   ] spawn_process: at 2018-11-29 23:48:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:48:08 [DEBUG   ] Got command BAM from MCS: ref #671419
2018-11-29 23:48:08 [INFO    ] Finished processing BAM request
2018-11-29 23:48:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671419   8 58451 85688045 A  ERROR'
2018-11-29 23:48:08 [DEBUG   ] Got command BAM from MCS: ref #671420
2018-11-29 23:48:08 [INFO    ] Finished processing BAM request
2018-11-29 23:48:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671420   8 58451 85688049 A  ERROR'
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:48:08 [DEBUG   ] spawn_process: at 2018-11-29 23:48:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:48:14 [DEBUG   ] Got command BAM from MCS: ref #671421
2018-11-29 23:48:14 [INFO    ] Finished processing BAM request
2018-11-29 23:48:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671421   8 58451 85694033 A  ERROR'
2018-11-29 23:48:14 [DEBUG   ] Got command BAM from MCS: ref #671422
2018-11-29 23:48:14 [INFO    ] Finished processing BAM request
2018-11-29 23:48:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671422   8 58451 85694037 A  ERROR'
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:48:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:48:14 [DEBUG   ] spawn_process: at 2018-11-29 23:48:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:48:16 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-11-29 23:48:20 [DEBUG   ] Got command BAM from MCS: ref #671423
2018-11-29 23:48:20 [INFO    ] Finished processing BAM request
2018-11-29 23:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671423   8 58451 85700033 A  ERROR'
2018-11-29 23:48:20 [DEBUG   ] Got command BAM from MCS: ref #671424
2018-11-29 23:48:20 [INFO    ] Finished processing BAM request
2018-11-29 23:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671424   8 58451 85700037 A  ERROR'
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:48:20 [DEBUG   ] spawn_process: at 2018-11-29 23:48:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:48:26 [DEBUG   ] Got command BAM from MCS: ref #671426
2018-11-29 23:48:26 [INFO    ] Finished processing BAM request
2018-11-29 23:48:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671426   8 58451 85706029 A  ERROR'
2018-11-29 23:48:26 [DEBUG   ] Got command BAM from MCS: ref #671425
2018-11-29 23:48:26 [INFO    ] Finished processing BAM request
2018-11-29 23:48:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671425   8 58451 85706033 A  ERROR'
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:48:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:48:26 [DEBUG   ] spawn_process: at 2018-11-29 23:48:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:48:32 [DEBUG   ] Got command BAM from MCS: ref #671427
2018-11-29 23:48:32 [INFO    ] Finished processing BAM request
2018-11-29 23:48:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671427   8 58451 85712029 A  ERROR'
2018-11-29 23:48:32 [DEBUG   ] Got command BAM from MCS: ref #671428
2018-11-29 23:48:32 [INFO    ] Finished processing BAM request
2018-11-29 23:48:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671428   8 58451 85712033 A  ERROR'
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:48:32 [DEBUG   ] spawn_process: at 2018-11-29 23:48:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:48:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:48:38 [DEBUG   ] Got command BAM from MCS: ref #671430
2018-11-29 23:48:38 [INFO    ] Finished processing BAM request
2018-11-29 23:48:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671430   8 58451 85718029 A  ERROR'
2018-11-29 23:48:38 [DEBUG   ] Got command BAM from MCS: ref #671429
2018-11-29 23:48:38 [INFO    ] Finished processing BAM request
2018-11-29 23:48:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671429   8 58451 85718033 A  ERROR'
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:48:38 [DEBUG   ] spawn_process: at 2018-11-29 23:48:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:48:44 [DEBUG   ] Got command BAM from MCS: ref #671432
2018-11-29 23:48:44 [INFO    ] Finished processing BAM request
2018-11-29 23:48:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671432   8 58451 85724025 A  ERROR'
2018-11-29 23:48:44 [DEBUG   ] Got command BAM from MCS: ref #671431
2018-11-29 23:48:44 [INFO    ] Finished processing BAM request
2018-11-29 23:48:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671431   8 58451 85724029 A  ERROR'
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:48:44 [DEBUG   ] spawn_process: at 2018-11-29 23:48:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:48:50 [DEBUG   ] Got command BAM from MCS: ref #671433
2018-11-29 23:48:50 [INFO    ] Finished processing BAM request
2018-11-29 23:48:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671433   8 58451 85730029 A  ERROR'
2018-11-29 23:48:50 [DEBUG   ] Got command BAM from MCS: ref #671434
2018-11-29 23:48:50 [INFO    ] Finished processing BAM request
2018-11-29 23:48:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671434   8 58451 85730033 A  ERROR'
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:48:50 [DEBUG   ] spawn_process: at 2018-11-29 23:48:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:48:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:48:56 [DEBUG   ] Got command BAM from MCS: ref #671436
2018-11-29 23:48:56 [INFO    ] Finished processing BAM request
2018-11-29 23:48:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671436   8 58451 85736033 A  ERROR'
2018-11-29 23:48:56 [DEBUG   ] Got command BAM from MCS: ref #671435
2018-11-29 23:48:56 [INFO    ] Finished processing BAM request
2018-11-29 23:48:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:48:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671435   8 58451 85736037 A  ERROR'
2018-11-29 23:48:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-29 23:48:56 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:48:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:48:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:48:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:48:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:48:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:48:56 [DEBUG   ] Finished updating board flags in 2.145 seconds
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:48:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:48:56 [DEBUG   ] spawn_process: at 2018-11-29 23:48:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:49:02 [DEBUG   ] Got command BAM from MCS: ref #671438
2018-11-29 23:49:02 [INFO    ] Finished processing BAM request
2018-11-29 23:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671438   8 58451 85742029 A  ERROR'
2018-11-29 23:49:02 [DEBUG   ] Got command BAM from MCS: ref #671437
2018-11-29 23:49:02 [INFO    ] Finished processing BAM request
2018-11-29 23:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671437   8 58451 85742033 A  ERROR'
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:49:02 [DEBUG   ] spawn_process: at 2018-11-29 23:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:49:04 [DEBUG   ] Got command RPT from MCS: ref #671439
2018-11-29 23:49:04 [DEBUG   ] summary = ERROR
2018-11-29 23:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671439  13 58451 85744697 A  ERRORERROR'
2018-11-29 23:49:04 [DEBUG   ] Got command RPT from MCS: ref #671440
2018-11-29 23:49:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671440  77 58451 85744889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:49:05 [DEBUG   ] Got command RPT from MCS: ref #671441
2018-11-29 23:49:05 [DEBUG   ] summary = ERROR
2018-11-29 23:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671441  13 58451 85745093 A  ERRORERROR'
2018-11-29 23:49:05 [DEBUG   ] Got command RPT from MCS: ref #671442
2018-11-29 23:49:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671442  77 58451 85745297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:49:05 [DEBUG   ] Got command RPT from MCS: ref #671443
2018-11-29 23:49:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671443  12 58451 85745489 A  ERRORB¥ff'
2018-11-29 23:49:08 [DEBUG   ] Got command BAM from MCS: ref #671445
2018-11-29 23:49:08 [INFO    ] Finished processing BAM request
2018-11-29 23:49:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671445   8 58451 85748025 A  ERROR'
2018-11-29 23:49:08 [DEBUG   ] Got command BAM from MCS: ref #671444
2018-11-29 23:49:08 [INFO    ] Finished processing BAM request
2018-11-29 23:49:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671444   8 58451 85748029 A  ERROR'
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:49:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:49:08 [DEBUG   ] spawn_process: at 2018-11-29 23:49:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:49:14 [DEBUG   ] Got command BAM from MCS: ref #671446
2018-11-29 23:49:14 [INFO    ] Finished processing BAM request
2018-11-29 23:49:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671446   8 58451 85754033 A  ERROR'
2018-11-29 23:49:14 [DEBUG   ] Got command BAM from MCS: ref #671447
2018-11-29 23:49:14 [INFO    ] Finished processing BAM request
2018-11-29 23:49:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671447   8 58451 85754037 A  ERROR'
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:49:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:49:14 [DEBUG   ] spawn_process: at 2018-11-29 23:49:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:49:16 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-29 23:49:20 [DEBUG   ] Got command BAM from MCS: ref #671448
2018-11-29 23:49:20 [INFO    ] Finished processing BAM request
2018-11-29 23:49:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671448   8 58451 85760033 A  ERROR'
2018-11-29 23:49:20 [DEBUG   ] Got command BAM from MCS: ref #671449
2018-11-29 23:49:20 [INFO    ] Finished processing BAM request
2018-11-29 23:49:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671449   8 58451 85760041 A  ERROR'
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:49:20 [DEBUG   ] spawn_process: at 2018-11-29 23:49:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:49:26 [DEBUG   ] Got command BAM from MCS: ref #671451
2018-11-29 23:49:26 [INFO    ] Finished processing BAM request
2018-11-29 23:49:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671451   8 58451 85766037 A  ERROR'
2018-11-29 23:49:26 [DEBUG   ] Got command BAM from MCS: ref #671450
2018-11-29 23:49:26 [INFO    ] Finished processing BAM request
2018-11-29 23:49:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671450   8 58451 85766045 A  ERROR'
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:49:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:49:26 [DEBUG   ] spawn_process: at 2018-11-29 23:49:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:49:32 [DEBUG   ] Got command BAM from MCS: ref #671452
2018-11-29 23:49:32 [INFO    ] Finished processing BAM request
2018-11-29 23:49:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671452   8 58451 85772025 A  ERROR'
2018-11-29 23:49:32 [DEBUG   ] Got command BAM from MCS: ref #671453
2018-11-29 23:49:32 [INFO    ] Finished processing BAM request
2018-11-29 23:49:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671453   8 58451 85772029 A  ERROR'
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:49:32 [DEBUG   ] spawn_process: at 2018-11-29 23:49:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:49:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-29 23:49:38 [DEBUG   ] Got command BAM from MCS: ref #671455
2018-11-29 23:49:38 [INFO    ] Finished processing BAM request
2018-11-29 23:49:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671455   8 58451 85778029 A  ERROR'
2018-11-29 23:49:38 [DEBUG   ] Got command BAM from MCS: ref #671454
2018-11-29 23:49:38 [INFO    ] Finished processing BAM request
2018-11-29 23:49:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671454   8 58451 85778033 A  ERROR'
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:49:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:49:38 [DEBUG   ] spawn_process: at 2018-11-29 23:49:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:49:44 [DEBUG   ] Got command BAM from MCS: ref #671456
2018-11-29 23:49:44 [INFO    ] Finished processing BAM request
2018-11-29 23:49:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671456   8 58451 85784025 A  ERROR'
2018-11-29 23:49:44 [DEBUG   ] Got command BAM from MCS: ref #671457
2018-11-29 23:49:44 [INFO    ] Finished processing BAM request
2018-11-29 23:49:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671457   8 58451 85784029 A  ERROR'
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:49:44 [DEBUG   ] spawn_process: at 2018-11-29 23:49:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:49:50 [DEBUG   ] Got command BAM from MCS: ref #671458
2018-11-29 23:49:50 [INFO    ] Finished processing BAM request
2018-11-29 23:49:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671458   8 58451 85790025 A  ERROR'
2018-11-29 23:49:50 [DEBUG   ] Got command BAM from MCS: ref #671459
2018-11-29 23:49:50 [INFO    ] Finished processing BAM request
2018-11-29 23:49:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671459   8 58451 85790029 A  ERROR'
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:49:50 [DEBUG   ] spawn_process: at 2018-11-29 23:49:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 23:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 23:49:55 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:49:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:49:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:49:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:49:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:49:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:49:55 [DEBUG   ] Finished updating board flags in 1.276 seconds
2018-11-29 23:49:56 [DEBUG   ] Got command BAM from MCS: ref #671460
2018-11-29 23:49:56 [INFO    ] Finished processing BAM request
2018-11-29 23:49:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671460   8 58451 85796029 A  ERROR'
2018-11-29 23:49:56 [DEBUG   ] Got command BAM from MCS: ref #671461
2018-11-29 23:49:56 [INFO    ] Finished processing BAM request
2018-11-29 23:49:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671461   8 58451 85796033 A  ERROR'
2018-11-29 23:49:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:49:56 [DEBUG   ] spawn_process: at 2018-11-29 23:49:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:50:02 [DEBUG   ] Got command BAM from MCS: ref #671463
2018-11-29 23:50:02 [INFO    ] Finished processing BAM request
2018-11-29 23:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671463   8 58451 85802033 A  ERROR'
2018-11-29 23:50:02 [DEBUG   ] Got command BAM from MCS: ref #671462
2018-11-29 23:50:02 [INFO    ] Finished processing BAM request
2018-11-29 23:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671462   8 58451 85802037 A  ERROR'
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:50:02 [DEBUG   ] spawn_process: at 2018-11-29 23:50:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:50:08 [DEBUG   ] Got command BAM from MCS: ref #671465
2018-11-29 23:50:08 [INFO    ] Finished processing BAM request
2018-11-29 23:50:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671465   8 58451 85808033 A  ERROR'
2018-11-29 23:50:08 [DEBUG   ] Got command BAM from MCS: ref #671464
2018-11-29 23:50:08 [INFO    ] Finished processing BAM request
2018-11-29 23:50:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671464   8 58451 85808037 A  ERROR'
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:50:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:50:08 [DEBUG   ] spawn_process: at 2018-11-29 23:50:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:50:14 [DEBUG   ] Got command BAM from MCS: ref #671466
2018-11-29 23:50:14 [INFO    ] Finished processing BAM request
2018-11-29 23:50:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671466   8 58451 85814029 A  ERROR'
2018-11-29 23:50:14 [DEBUG   ] Got command BAM from MCS: ref #671467
2018-11-29 23:50:14 [INFO    ] Finished processing BAM request
2018-11-29 23:50:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671467   8 58451 85814033 A  ERROR'
2018-11-29 23:50:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:50:14 [DEBUG   ] spawn_process: at 2018-11-29 23:50:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:50:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:50:15 [DEBUG   ] spawn_process: at 2018-11-29 23:50:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:50:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:50:20 [DEBUG   ] Got command BAM from MCS: ref #671473
2018-11-29 23:50:20 [INFO    ] Finished processing BAM request
2018-11-29 23:50:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671473   8 58451 85820029 A  ERROR'
2018-11-29 23:50:20 [DEBUG   ] Got command BAM from MCS: ref #671472
2018-11-29 23:50:20 [INFO    ] Finished processing BAM request
2018-11-29 23:50:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671472   8 58451 85820033 A  ERROR'
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:50:20 [DEBUG   ] spawn_process: at 2018-11-29 23:50:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:50:26 [DEBUG   ] Got command BAM from MCS: ref #671474
2018-11-29 23:50:26 [INFO    ] Finished processing BAM request
2018-11-29 23:50:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671474   8 58451 85826025 A  ERROR'
2018-11-29 23:50:26 [DEBUG   ] Got command BAM from MCS: ref #671475
2018-11-29 23:50:26 [INFO    ] Finished processing BAM request
2018-11-29 23:50:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671475   8 58451 85826029 A  ERROR'
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:50:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:50:26 [DEBUG   ] spawn_process: at 2018-11-29 23:50:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:50:32 [DEBUG   ] Got command BAM from MCS: ref #671476
2018-11-29 23:50:32 [INFO    ] Finished processing BAM request
2018-11-29 23:50:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671476   8 58451 85832033 A  ERROR'
2018-11-29 23:50:32 [DEBUG   ] Got command BAM from MCS: ref #671477
2018-11-29 23:50:32 [INFO    ] Finished processing BAM request
2018-11-29 23:50:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671477   8 58451 85832037 A  ERROR'
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:50:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:50:32 [DEBUG   ] spawn_process: at 2018-11-29 23:50:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:50:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:50:38 [DEBUG   ] Got command BAM from MCS: ref #671478
2018-11-29 23:50:38 [INFO    ] Finished processing BAM request
2018-11-29 23:50:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671478   8 58451 85838029 A  ERROR'
2018-11-29 23:50:38 [DEBUG   ] Got command BAM from MCS: ref #671479
2018-11-29 23:50:38 [INFO    ] Finished processing BAM request
2018-11-29 23:50:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671479   8 58451 85838033 A  ERROR'
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:50:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:50:38 [DEBUG   ] spawn_process: at 2018-11-29 23:50:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:50:44 [DEBUG   ] Got command BAM from MCS: ref #671481
2018-11-29 23:50:44 [INFO    ] Finished processing BAM request
2018-11-29 23:50:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671481   8 58451 85844025 A  ERROR'
2018-11-29 23:50:44 [DEBUG   ] Got command BAM from MCS: ref #671480
2018-11-29 23:50:44 [INFO    ] Finished processing BAM request
2018-11-29 23:50:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671480   8 58451 85844029 A  ERROR'
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:50:44 [DEBUG   ] spawn_process: at 2018-11-29 23:50:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:50:49 [DEBUG   ] Got command RPT from MCS: ref #671484
2018-11-29 23:50:49 [DEBUG   ] summary = ERROR
2018-11-29 23:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671484  13 58451 85849956 A  ERRORERROR'
2018-11-29 23:50:49 [DEBUG   ] Got command RPT from MCS: ref #671485
2018-11-29 23:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671485  77 58451 85849956 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:50:50 [DEBUG   ] Got command BAM from MCS: ref #671483
2018-11-29 23:50:50 [INFO    ] Finished processing BAM request
2018-11-29 23:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671483   8 58451 85850334 A  ERROR'
2018-11-29 23:50:50 [DEBUG   ] Got command BAM from MCS: ref #671482
2018-11-29 23:50:50 [INFO    ] Finished processing BAM request
2018-11-29 23:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671482   8 58451 85850338 A  ERROR'
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:50:50 [DEBUG   ] spawn_process: at 2018-11-29 23:50:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-29 23:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 23:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-29 23:50:55 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:50:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:50:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:50:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:50:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:50:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:50:55 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-29 23:50:56 [DEBUG   ] Got command BAM from MCS: ref #671501
2018-11-29 23:50:56 [INFO    ] Finished processing BAM request
2018-11-29 23:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671501   8 58451 85856029 A  ERROR'
2018-11-29 23:50:56 [DEBUG   ] Got command BAM from MCS: ref #671502
2018-11-29 23:50:56 [INFO    ] Finished processing BAM request
2018-11-29 23:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671502   8 58451 85856033 A  ERROR'
2018-11-29 23:50:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:50:56 [DEBUG   ] spawn_process: at 2018-11-29 23:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:51:02 [DEBUG   ] Got command BAM from MCS: ref #671503
2018-11-29 23:51:02 [INFO    ] Finished processing BAM request
2018-11-29 23:51:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671503   8 58451 85862029 A  ERROR'
2018-11-29 23:51:02 [DEBUG   ] Got command BAM from MCS: ref #671504
2018-11-29 23:51:02 [INFO    ] Finished processing BAM request
2018-11-29 23:51:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671504   8 58451 85862033 A  ERROR'
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:51:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:51:02 [DEBUG   ] spawn_process: at 2018-11-29 23:51:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:51:08 [DEBUG   ] Got command BAM from MCS: ref #671506
2018-11-29 23:51:08 [INFO    ] Finished processing BAM request
2018-11-29 23:51:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671506   8 58451 85868025 A  ERROR'
2018-11-29 23:51:08 [DEBUG   ] Got command BAM from MCS: ref #671505
2018-11-29 23:51:08 [INFO    ] Finished processing BAM request
2018-11-29 23:51:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671505   8 58451 85868029 A  ERROR'
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:51:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:51:08 [DEBUG   ] spawn_process: at 2018-11-29 23:51:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:51:14 [DEBUG   ] Got command BAM from MCS: ref #671507
2018-11-29 23:51:14 [INFO    ] Finished processing BAM request
2018-11-29 23:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671507   8 58451 85874033 A  ERROR'
2018-11-29 23:51:14 [DEBUG   ] Got command BAM from MCS: ref #671508
2018-11-29 23:51:14 [INFO    ] Finished processing BAM request
2018-11-29 23:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671508   8 58451 85874037 A  ERROR'
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:51:14 [DEBUG   ] spawn_process: at 2018-11-29 23:51:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:51:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-29 23:51:20 [DEBUG   ] Got command BAM from MCS: ref #671510
2018-11-29 23:51:20 [INFO    ] Finished processing BAM request
2018-11-29 23:51:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671510   8 58451 85880033 A  ERROR'
2018-11-29 23:51:20 [DEBUG   ] Got command BAM from MCS: ref #671509
2018-11-29 23:51:20 [INFO    ] Finished processing BAM request
2018-11-29 23:51:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671509   8 58451 85880037 A  ERROR'
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:51:20 [DEBUG   ] spawn_process: at 2018-11-29 23:51:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:51:26 [DEBUG   ] Got command BAM from MCS: ref #671511
2018-11-29 23:51:26 [INFO    ] Finished processing BAM request
2018-11-29 23:51:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671511   8 58451 85886025 A  ERROR'
2018-11-29 23:51:26 [DEBUG   ] Got command BAM from MCS: ref #671512
2018-11-29 23:51:26 [INFO    ] Finished processing BAM request
2018-11-29 23:51:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671512   8 58451 85886029 A  ERROR'
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:51:26 [DEBUG   ] spawn_process: at 2018-11-29 23:51:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:51:32 [DEBUG   ] Got command BAM from MCS: ref #671514
2018-11-29 23:51:32 [INFO    ] Finished processing BAM request
2018-11-29 23:51:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671514   8 58451 85892025 A  ERROR'
2018-11-29 23:51:32 [DEBUG   ] Got command BAM from MCS: ref #671513
2018-11-29 23:51:32 [INFO    ] Finished processing BAM request
2018-11-29 23:51:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671513   8 58451 85892029 A  ERROR'
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:51:32 [DEBUG   ] spawn_process: at 2018-11-29 23:51:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:51:36 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-29 23:51:38 [DEBUG   ] Got command BAM from MCS: ref #671515
2018-11-29 23:51:38 [INFO    ] Finished processing BAM request
2018-11-29 23:51:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671515   8 58451 85898025 A  ERROR'
2018-11-29 23:51:38 [DEBUG   ] Got command BAM from MCS: ref #671516
2018-11-29 23:51:38 [INFO    ] Finished processing BAM request
2018-11-29 23:51:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671516   8 58451 85898029 A  ERROR'
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:51:38 [DEBUG   ] spawn_process: at 2018-11-29 23:51:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:51:44 [DEBUG   ] Got command BAM from MCS: ref #671518
2018-11-29 23:51:44 [INFO    ] Finished processing BAM request
2018-11-29 23:51:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671518   8 58451 85904033 A  ERROR'
2018-11-29 23:51:44 [DEBUG   ] Got command BAM from MCS: ref #671517
2018-11-29 23:51:44 [INFO    ] Finished processing BAM request
2018-11-29 23:51:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671517   8 58451 85904037 A  ERROR'
2018-11-29 23:51:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:51:44 [DEBUG   ] spawn_process: at 2018-11-29 23:51:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:51:45 [DEBUG   ] spawn_process: at 2018-11-29 23:51:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:51:50 [DEBUG   ] Got command BAM from MCS: ref #671520
2018-11-29 23:51:50 [INFO    ] Finished processing BAM request
2018-11-29 23:51:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671520   8 58451 85910029 A  ERROR'
2018-11-29 23:51:50 [DEBUG   ] Got command BAM from MCS: ref #671519
2018-11-29 23:51:50 [INFO    ] Finished processing BAM request
2018-11-29 23:51:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671519   8 58451 85910033 A  ERROR'
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:51:50 [DEBUG   ] spawn_process: at 2018-11-29 23:51:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:51:55 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:51:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:51:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:51:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:51:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:51:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:51:55 [DEBUG   ] Finished updating board flags in 1.174 seconds
2018-11-29 23:51:56 [DEBUG   ] Got command BAM from MCS: ref #671521
2018-11-29 23:51:56 [INFO    ] Finished processing BAM request
2018-11-29 23:51:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671521   8 58451 85916029 A  ERROR'
2018-11-29 23:51:56 [DEBUG   ] Got command BAM from MCS: ref #671522
2018-11-29 23:51:56 [INFO    ] Finished processing BAM request
2018-11-29 23:51:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671522   8 58451 85916033 A  ERROR'
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:51:56 [DEBUG   ] spawn_process: at 2018-11-29 23:51:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:51:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:52:02 [DEBUG   ] Got command BAM from MCS: ref #671523
2018-11-29 23:52:02 [INFO    ] Finished processing BAM request
2018-11-29 23:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671523   8 58451 85922025 A  ERROR'
2018-11-29 23:52:02 [DEBUG   ] Got command BAM from MCS: ref #671524
2018-11-29 23:52:02 [INFO    ] Finished processing BAM request
2018-11-29 23:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671524   8 58451 85922029 A  ERROR'
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:52:02 [DEBUG   ] spawn_process: at 2018-11-29 23:52:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:52:08 [DEBUG   ] Got command BAM from MCS: ref #671526
2018-11-29 23:52:08 [INFO    ] Finished processing BAM request
2018-11-29 23:52:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671526   8 58451 85928033 A  ERROR'
2018-11-29 23:52:08 [DEBUG   ] Got command BAM from MCS: ref #671525
2018-11-29 23:52:08 [INFO    ] Finished processing BAM request
2018-11-29 23:52:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671525   8 58451 85928037 A  ERROR'
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:52:08 [DEBUG   ] spawn_process: at 2018-11-29 23:52:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:52:14 [DEBUG   ] Got command BAM from MCS: ref #671527
2018-11-29 23:52:14 [INFO    ] Finished processing BAM request
2018-11-29 23:52:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671527   8 58451 85934029 A  ERROR'
2018-11-29 23:52:14 [DEBUG   ] Got command BAM from MCS: ref #671528
2018-11-29 23:52:14 [INFO    ] Finished processing BAM request
2018-11-29 23:52:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671528   8 58451 85934033 A  ERROR'
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:52:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:52:14 [DEBUG   ] spawn_process: at 2018-11-29 23:52:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:52:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-29 23:52:20 [DEBUG   ] Got command BAM from MCS: ref #671530
2018-11-29 23:52:20 [INFO    ] Finished processing BAM request
2018-11-29 23:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671530   8 58451 85940029 A  ERROR'
2018-11-29 23:52:20 [DEBUG   ] Got command BAM from MCS: ref #671529
2018-11-29 23:52:20 [INFO    ] Finished processing BAM request
2018-11-29 23:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671529   8 58451 85940033 A  ERROR'
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:52:20 [DEBUG   ] spawn_process: at 2018-11-29 23:52:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:52:26 [DEBUG   ] Got command BAM from MCS: ref #671531
2018-11-29 23:52:26 [INFO    ] Finished processing BAM request
2018-11-29 23:52:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671531   8 58451 85946033 A  ERROR'
2018-11-29 23:52:26 [DEBUG   ] Got command BAM from MCS: ref #671532
2018-11-29 23:52:26 [INFO    ] Finished processing BAM request
2018-11-29 23:52:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671532   8 58451 85946037 A  ERROR'
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:52:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:52:26 [DEBUG   ] spawn_process: at 2018-11-29 23:52:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:52:32 [DEBUG   ] Got command BAM from MCS: ref #671534
2018-11-29 23:52:32 [INFO    ] Finished processing BAM request
2018-11-29 23:52:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671534   8 58451 85952029 A  ERROR'
2018-11-29 23:52:32 [DEBUG   ] Got command BAM from MCS: ref #671533
2018-11-29 23:52:32 [INFO    ] Finished processing BAM request
2018-11-29 23:52:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671533   8 58451 85952033 A  ERROR'
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:52:32 [DEBUG   ] spawn_process: at 2018-11-29 23:52:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:52:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-29 23:52:38 [DEBUG   ] Got command BAM from MCS: ref #671536
2018-11-29 23:52:38 [INFO    ] Finished processing BAM request
2018-11-29 23:52:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671536   8 58451 85958025 A  ERROR'
2018-11-29 23:52:38 [DEBUG   ] Got command BAM from MCS: ref #671535
2018-11-29 23:52:38 [INFO    ] Finished processing BAM request
2018-11-29 23:52:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671535   8 58451 85958029 A  ERROR'
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:52:38 [DEBUG   ] spawn_process: at 2018-11-29 23:52:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:52:44 [DEBUG   ] Got command BAM from MCS: ref #671537
2018-11-29 23:52:44 [INFO    ] Finished processing BAM request
2018-11-29 23:52:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671537   8 58451 85964033 A  ERROR'
2018-11-29 23:52:44 [DEBUG   ] Got command BAM from MCS: ref #671538
2018-11-29 23:52:44 [INFO    ] Finished processing BAM request
2018-11-29 23:52:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671538   8 58451 85964037 A  ERROR'
2018-11-29 23:52:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:52:44 [DEBUG   ] spawn_process: at 2018-11-29 23:52:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:52:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:52:45 [DEBUG   ] spawn_process: at 2018-11-29 23:52:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:52:50 [DEBUG   ] Got command BAM from MCS: ref #671539
2018-11-29 23:52:50 [INFO    ] Finished processing BAM request
2018-11-29 23:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671539   8 58451 85970029 A  ERROR'
2018-11-29 23:52:50 [DEBUG   ] Got command BAM from MCS: ref #671540
2018-11-29 23:52:50 [INFO    ] Finished processing BAM request
2018-11-29 23:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671540   8 58451 85970033 A  ERROR'
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:52:50 [DEBUG   ] spawn_process: at 2018-11-29 23:52:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:52:55 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:52:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:52:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:52:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:52:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:52:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:52:55 [DEBUG   ] Finished updating board flags in 1.026 seconds
2018-11-29 23:52:56 [DEBUG   ] Got command BAM from MCS: ref #671541
2018-11-29 23:52:56 [INFO    ] Finished processing BAM request
2018-11-29 23:52:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671541   8 58451 85976033 A  ERROR'
2018-11-29 23:52:56 [DEBUG   ] Got command BAM from MCS: ref #671542
2018-11-29 23:52:56 [INFO    ] Finished processing BAM request
2018-11-29 23:52:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:52:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671542   8 58451 85976037 A  ERROR'
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:52:56 [DEBUG   ] spawn_process: at 2018-11-29 23:52:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:52:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-29 23:53:02 [DEBUG   ] Got command BAM from MCS: ref #671544
2018-11-29 23:53:02 [INFO    ] Finished processing BAM request
2018-11-29 23:53:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671544   8 58451 85982033 A  ERROR'
2018-11-29 23:53:02 [DEBUG   ] Got command BAM from MCS: ref #671543
2018-11-29 23:53:02 [INFO    ] Finished processing BAM request
2018-11-29 23:53:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671543   8 58451 85982037 A  ERROR'
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:53:02 [DEBUG   ] spawn_process: at 2018-11-29 23:53:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:53:08 [DEBUG   ] Got command BAM from MCS: ref #671545
2018-11-29 23:53:08 [INFO    ] Finished processing BAM request
2018-11-29 23:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671545   8 58451 85988029 A  ERROR'
2018-11-29 23:53:08 [DEBUG   ] Got command BAM from MCS: ref #671546
2018-11-29 23:53:08 [INFO    ] Finished processing BAM request
2018-11-29 23:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671546   8 58451 85988033 A  ERROR'
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:53:08 [DEBUG   ] spawn_process: at 2018-11-29 23:53:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:53:14 [DEBUG   ] Got command BAM from MCS: ref #671548
2018-11-29 23:53:14 [INFO    ] Finished processing BAM request
2018-11-29 23:53:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671548   8 58451 85994025 A  ERROR'
2018-11-29 23:53:14 [DEBUG   ] Got command BAM from MCS: ref #671547
2018-11-29 23:53:14 [INFO    ] Finished processing BAM request
2018-11-29 23:53:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671547   8 58451 85994029 A  ERROR'
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:53:14 [DEBUG   ] spawn_process: at 2018-11-29 23:53:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:53:20 [DEBUG   ] Got command BAM from MCS: ref #671553
2018-11-29 23:53:20 [INFO    ] Finished processing BAM request
2018-11-29 23:53:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671553   8 58451 86000033 A  ERROR'
2018-11-29 23:53:20 [DEBUG   ] Got command BAM from MCS: ref #671554
2018-11-29 23:53:20 [INFO    ] Finished processing BAM request
2018-11-29 23:53:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671554   8 58451 86000037 A  ERROR'
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:53:20 [DEBUG   ] spawn_process: at 2018-11-29 23:53:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:53:26 [DEBUG   ] Got command BAM from MCS: ref #671555
2018-11-29 23:53:26 [INFO    ] Finished processing BAM request
2018-11-29 23:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671555   8 58451 86006029 A  ERROR'
2018-11-29 23:53:26 [DEBUG   ] Got command BAM from MCS: ref #671556
2018-11-29 23:53:26 [INFO    ] Finished processing BAM request
2018-11-29 23:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671556   8 58451 86006033 A  ERROR'
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:53:26 [DEBUG   ] spawn_process: at 2018-11-29 23:53:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:53:32 [DEBUG   ] Got command BAM from MCS: ref #671557
2018-11-29 23:53:32 [INFO    ] Finished processing BAM request
2018-11-29 23:53:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671557   8 58451 86012025 A  ERROR'
2018-11-29 23:53:32 [DEBUG   ] Got command BAM from MCS: ref #671558
2018-11-29 23:53:32 [INFO    ] Finished processing BAM request
2018-11-29 23:53:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671558   8 58451 86012029 A  ERROR'
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:53:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:53:32 [DEBUG   ] spawn_process: at 2018-11-29 23:53:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:53:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-29 23:53:38 [DEBUG   ] Got command BAM from MCS: ref #671559
2018-11-29 23:53:38 [INFO    ] Finished processing BAM request
2018-11-29 23:53:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671559   8 58451 86018029 A  ERROR'
2018-11-29 23:53:38 [DEBUG   ] Got command BAM from MCS: ref #671560
2018-11-29 23:53:38 [INFO    ] Finished processing BAM request
2018-11-29 23:53:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671560   8 58451 86018033 A  ERROR'
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:53:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:53:38 [DEBUG   ] spawn_process: at 2018-11-29 23:53:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:53:44 [DEBUG   ] Got command BAM from MCS: ref #671563
2018-11-29 23:53:44 [INFO    ] Finished processing BAM request
2018-11-29 23:53:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671563   8 58451 86024029 A  ERROR'
2018-11-29 23:53:44 [DEBUG   ] Got command BAM from MCS: ref #671564
2018-11-29 23:53:44 [INFO    ] Finished processing BAM request
2018-11-29 23:53:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671564   8 58451 86024033 A  ERROR'
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:53:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:53:44 [DEBUG   ] spawn_process: at 2018-11-29 23:53:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:53:50 [DEBUG   ] Got command BAM from MCS: ref #671566
2018-11-29 23:53:50 [INFO    ] Finished processing BAM request
2018-11-29 23:53:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671566   8 58451 86030025 A  ERROR'
2018-11-29 23:53:50 [DEBUG   ] Got command BAM from MCS: ref #671565
2018-11-29 23:53:50 [INFO    ] Finished processing BAM request
2018-11-29 23:53:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671565   8 58451 86030029 A  ERROR'
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:53:50 [DEBUG   ] spawn_process: at 2018-11-29 23:53:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:53:55 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2018-11-29 23:53:55 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2018-11-29 23:53:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:53:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:53:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:53:55 [WARNING ] (13, 1, 'bot')
2018-11-29 23:53:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:53:55 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-29 23:53:56 [DEBUG   ] Got command BAM from MCS: ref #671567
2018-11-29 23:53:56 [INFO    ] Finished processing BAM request
2018-11-29 23:53:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671567   8 58451 86036033 A  ERROR'
2018-11-29 23:53:56 [DEBUG   ] Got command BAM from MCS: ref #671568
2018-11-29 23:53:56 [INFO    ] Finished processing BAM request
2018-11-29 23:53:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:53:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671568   8 58451 86036037 A  ERROR'
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:53:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:53:56 [DEBUG   ] spawn_process: at 2018-11-29 23:53:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:53:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-29 23:54:02 [DEBUG   ] Got command BAM from MCS: ref #671570
2018-11-29 23:54:02 [INFO    ] Finished processing BAM request
2018-11-29 23:54:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671570   8 58451 86042029 A  ERROR'
2018-11-29 23:54:02 [DEBUG   ] Got command BAM from MCS: ref #671569
2018-11-29 23:54:02 [INFO    ] Finished processing BAM request
2018-11-29 23:54:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671569   8 58451 86042033 A  ERROR'
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:54:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:54:02 [DEBUG   ] spawn_process: at 2018-11-29 23:54:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:54:04 [DEBUG   ] Got command RPT from MCS: ref #671571
2018-11-29 23:54:04 [DEBUG   ] summary = ERROR
2018-11-29 23:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671571  13 58451 86044777 A  ERRORERROR'
2018-11-29 23:54:04 [DEBUG   ] Got command RPT from MCS: ref #671572
2018-11-29 23:54:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671572  77 58451 86044981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:54:05 [DEBUG   ] Got command RPT from MCS: ref #671573
2018-11-29 23:54:05 [DEBUG   ] summary = ERROR
2018-11-29 23:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671573  13 58451 86045185 A  ERRORERROR'
2018-11-29 23:54:05 [DEBUG   ] Got command RPT from MCS: ref #671575
2018-11-29 23:54:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671575  77 58451 86045589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:54:05 [DEBUG   ] Got command RPT from MCS: ref #671576
2018-11-29 23:54:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671576  12 58451 86045589 A  ERRORB¥ff'
2018-11-29 23:54:08 [DEBUG   ] Got command BAM from MCS: ref #671582
2018-11-29 23:54:08 [INFO    ] Finished processing BAM request
2018-11-29 23:54:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671582   8 58451 86048029 A  ERROR'
2018-11-29 23:54:08 [DEBUG   ] Got command BAM from MCS: ref #671581
2018-11-29 23:54:08 [INFO    ] Finished processing BAM request
2018-11-29 23:54:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671581   8 58451 86048033 A  ERROR'
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:54:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:54:08 [DEBUG   ] spawn_process: at 2018-11-29 23:54:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:54:14 [DEBUG   ] Got command BAM from MCS: ref #671584
2018-11-29 23:54:14 [INFO    ] Finished processing BAM request
2018-11-29 23:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671584   8 58451 86054029 A  ERROR'
2018-11-29 23:54:14 [DEBUG   ] Got command BAM from MCS: ref #671583
2018-11-29 23:54:14 [INFO    ] Finished processing BAM request
2018-11-29 23:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671583   8 58451 86054033 A  ERROR'
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:54:14 [DEBUG   ] spawn_process: at 2018-11-29 23:54:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:54:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-29 23:54:20 [DEBUG   ] Got command BAM from MCS: ref #671586
2018-11-29 23:54:20 [INFO    ] Finished processing BAM request
2018-11-29 23:54:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671586   8 58451 86060033 A  ERROR'
2018-11-29 23:54:20 [DEBUG   ] Got command BAM from MCS: ref #671585
2018-11-29 23:54:20 [INFO    ] Finished processing BAM request
2018-11-29 23:54:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671585   8 58451 86060041 A  ERROR'
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:54:20 [DEBUG   ] spawn_process: at 2018-11-29 23:54:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:54:26 [DEBUG   ] Got command BAM from MCS: ref #671588
2018-11-29 23:54:26 [INFO    ] Finished processing BAM request
2018-11-29 23:54:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671588   8 58451 86066033 A  ERROR'
2018-11-29 23:54:26 [DEBUG   ] Got command BAM from MCS: ref #671587
2018-11-29 23:54:26 [INFO    ] Finished processing BAM request
2018-11-29 23:54:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671587   8 58451 86066037 A  ERROR'
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:54:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:54:26 [DEBUG   ] spawn_process: at 2018-11-29 23:54:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:54:32 [DEBUG   ] Got command BAM from MCS: ref #671590
2018-11-29 23:54:32 [INFO    ] Finished processing BAM request
2018-11-29 23:54:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671590   8 58451 86072029 A  ERROR'
2018-11-29 23:54:32 [DEBUG   ] Got command BAM from MCS: ref #671589
2018-11-29 23:54:32 [INFO    ] Finished processing BAM request
2018-11-29 23:54:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671589   8 58451 86072033 A  ERROR'
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:54:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:54:32 [DEBUG   ] spawn_process: at 2018-11-29 23:54:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:54:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-29 23:54:38 [DEBUG   ] Got command BAM from MCS: ref #671591
2018-11-29 23:54:38 [INFO    ] Finished processing BAM request
2018-11-29 23:54:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671591   8 58451 86078033 A  ERROR'
2018-11-29 23:54:38 [DEBUG   ] Got command BAM from MCS: ref #671592
2018-11-29 23:54:38 [INFO    ] Finished processing BAM request
2018-11-29 23:54:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671592   8 58451 86078037 A  ERROR'
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:54:38 [DEBUG   ] spawn_process: at 2018-11-29 23:54:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:54:44 [DEBUG   ] Got command BAM from MCS: ref #671594
2018-11-29 23:54:44 [INFO    ] Finished processing BAM request
2018-11-29 23:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671594   8 58451 86084029 A  ERROR'
2018-11-29 23:54:44 [DEBUG   ] Got command BAM from MCS: ref #671593
2018-11-29 23:54:44 [INFO    ] Finished processing BAM request
2018-11-29 23:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671593   8 58451 86084033 A  ERROR'
2018-11-29 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:54:44 [DEBUG   ] spawn_process: at 2018-11-29 23:54:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:54:45 [DEBUG   ] spawn_process: at 2018-11-29 23:54:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:54:50 [DEBUG   ] Got command BAM from MCS: ref #671595
2018-11-29 23:54:50 [INFO    ] Finished processing BAM request
2018-11-29 23:54:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671595   8 58451 86090025 A  ERROR'
2018-11-29 23:54:50 [DEBUG   ] Got command BAM from MCS: ref #671596
2018-11-29 23:54:50 [INFO    ] Finished processing BAM request
2018-11-29 23:54:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671596   8 58451 86090029 A  ERROR'
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:54:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:54:50 [DEBUG   ] spawn_process: at 2018-11-29 23:54:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:54:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-29 23:54:56 [DEBUG   ] Got command BAM from MCS: ref #671598
2018-11-29 23:54:56 [INFO    ] Finished processing BAM request
2018-11-29 23:54:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671598   8 58451 86096041 A  ERROR'
2018-11-29 23:54:56 [DEBUG   ] Got command BAM from MCS: ref #671597
2018-11-29 23:54:56 [INFO    ] Finished processing BAM request
2018-11-29 23:54:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671597   8 58451 86096049 A  ERROR'
2018-11-29 23:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-29 23:54:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:54:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:54:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:54:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:54:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:54:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:54:56 [DEBUG   ] Finished updating board flags in 1.344 seconds
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:54:56 [DEBUG   ] spawn_process: at 2018-11-29 23:54:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:54:57 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-29 23:55:02 [DEBUG   ] Got command BAM from MCS: ref #671599
2018-11-29 23:55:02 [INFO    ] Finished processing BAM request
2018-11-29 23:55:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671599   8 58451 86102033 A  ERROR'
2018-11-29 23:55:02 [DEBUG   ] Got command BAM from MCS: ref #671600
2018-11-29 23:55:02 [INFO    ] Finished processing BAM request
2018-11-29 23:55:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671600   8 58451 86102037 A  ERROR'
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:55:02 [DEBUG   ] spawn_process: at 2018-11-29 23:55:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:55:08 [DEBUG   ] Got command BAM from MCS: ref #671601
2018-11-29 23:55:08 [INFO    ] Finished processing BAM request
2018-11-29 23:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671601   8 58451 86108029 A  ERROR'
2018-11-29 23:55:08 [DEBUG   ] Got command BAM from MCS: ref #671602
2018-11-29 23:55:08 [INFO    ] Finished processing BAM request
2018-11-29 23:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671602   8 58451 86108033 A  ERROR'
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:55:08 [DEBUG   ] spawn_process: at 2018-11-29 23:55:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:55:15 [DEBUG   ] Got command BAM from MCS: ref #671603
2018-11-29 23:55:15 [INFO    ] Finished processing BAM request
2018-11-29 23:55:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671603   8 58451 86115029 A  ERROR'
2018-11-29 23:55:15 [DEBUG   ] Got command BAM from MCS: ref #671604
2018-11-29 23:55:15 [INFO    ] Finished processing BAM request
2018-11-29 23:55:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671604   8 58451 86115033 A  ERROR'
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:55:15 [DEBUG   ] spawn_process: at 2018-11-29 23:55:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:55:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 23:55:22 [DEBUG   ] Got command BAM from MCS: ref #671605
2018-11-29 23:55:22 [INFO    ] Finished processing BAM request
2018-11-29 23:55:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671605   8 58451 86122029 A  ERROR'
2018-11-29 23:55:22 [DEBUG   ] Got command BAM from MCS: ref #671606
2018-11-29 23:55:22 [INFO    ] Finished processing BAM request
2018-11-29 23:55:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671606   8 58451 86122033 A  ERROR'
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:55:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:55:22 [DEBUG   ] spawn_process: at 2018-11-29 23:55:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:55:29 [DEBUG   ] Got command BAM from MCS: ref #671608
2018-11-29 23:55:29 [INFO    ] Finished processing BAM request
2018-11-29 23:55:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671608   8 58451 86129037 A  ERROR'
2018-11-29 23:55:29 [DEBUG   ] Got command BAM from MCS: ref #671607
2018-11-29 23:55:29 [INFO    ] Finished processing BAM request
2018-11-29 23:55:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671607   8 58451 86129045 A  ERROR'
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:55:29 [DEBUG   ] spawn_process: at 2018-11-29 23:55:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:55:36 [DEBUG   ] Got command BAM from MCS: ref #671609
2018-11-29 23:55:36 [INFO    ] Finished processing BAM request
2018-11-29 23:55:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671609   8 58451 86136025 A  ERROR'
2018-11-29 23:55:36 [DEBUG   ] Got command BAM from MCS: ref #671610
2018-11-29 23:55:36 [INFO    ] Finished processing BAM request
2018-11-29 23:55:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671610   8 58451 86136029 A  ERROR'
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:55:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:55:36 [DEBUG   ] spawn_process: at 2018-11-29 23:55:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:55:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:55:43 [DEBUG   ] Got command BAM from MCS: ref #671612
2018-11-29 23:55:43 [INFO    ] Finished processing BAM request
2018-11-29 23:55:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671612   8 58451 86143025 A  ERROR'
2018-11-29 23:55:43 [DEBUG   ] Got command BAM from MCS: ref #671611
2018-11-29 23:55:43 [INFO    ] Finished processing BAM request
2018-11-29 23:55:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671611   8 58451 86143029 A  ERROR'
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:55:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:55:43 [DEBUG   ] spawn_process: at 2018-11-29 23:55:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:55:49 [DEBUG   ] Got command RPT from MCS: ref #671615
2018-11-29 23:55:49 [DEBUG   ] summary = ERROR
2018-11-29 23:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671615  13 58451 86149837 A  ERRORERROR'
2018-11-29 23:55:49 [DEBUG   ] Got command RPT from MCS: ref #671616
2018-11-29 23:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671616  77 58451 86149838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:55:50 [DEBUG   ] Got command BAM from MCS: ref #671614
2018-11-29 23:55:50 [INFO    ] Finished processing BAM request
2018-11-29 23:55:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671614   8 58451 86150033 A  ERROR'
2018-11-29 23:55:50 [DEBUG   ] Got command BAM from MCS: ref #671613
2018-11-29 23:55:50 [INFO    ] Finished processing BAM request
2018-11-29 23:55:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671613   8 58451 86150037 A  ERROR'
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:55:50 [DEBUG   ] spawn_process: at 2018-11-29 23:55:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:55:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:55:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:55:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:55:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:55:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:55:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:55:56 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-29 23:55:57 [DEBUG   ] Got command BAM from MCS: ref #671633
2018-11-29 23:55:57 [INFO    ] Finished processing BAM request
2018-11-29 23:55:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671633   8 58451 86157029 A  ERROR'
2018-11-29 23:55:57 [DEBUG   ] Got command BAM from MCS: ref #671632
2018-11-29 23:55:57 [INFO    ] Finished processing BAM request
2018-11-29 23:55:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:55:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671632   8 58451 86157033 A  ERROR'
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:55:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:55:57 [DEBUG   ] spawn_process: at 2018-11-29 23:55:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:55:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:56:04 [DEBUG   ] Got command BAM from MCS: ref #671635
2018-11-29 23:56:04 [INFO    ] Finished processing BAM request
2018-11-29 23:56:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671635   8 58451 86164033 A  ERROR'
2018-11-29 23:56:04 [DEBUG   ] Got command BAM from MCS: ref #671634
2018-11-29 23:56:04 [INFO    ] Finished processing BAM request
2018-11-29 23:56:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671634   8 58451 86164037 A  ERROR'
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:56:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:56:04 [DEBUG   ] spawn_process: at 2018-11-29 23:56:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:56:11 [DEBUG   ] Got command BAM from MCS: ref #671637
2018-11-29 23:56:11 [INFO    ] Finished processing BAM request
2018-11-29 23:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671637   8 58451 86171033 A  ERROR'
2018-11-29 23:56:11 [DEBUG   ] Got command BAM from MCS: ref #671636
2018-11-29 23:56:11 [INFO    ] Finished processing BAM request
2018-11-29 23:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671636   8 58451 86171037 A  ERROR'
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:56:11 [DEBUG   ] spawn_process: at 2018-11-29 23:56:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:56:18 [DEBUG   ] Got command BAM from MCS: ref #671640
2018-11-29 23:56:18 [INFO    ] Finished processing BAM request
2018-11-29 23:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671640   8 58451 86178033 A  ERROR'
2018-11-29 23:56:18 [DEBUG   ] Got command BAM from MCS: ref #671641
2018-11-29 23:56:18 [INFO    ] Finished processing BAM request
2018-11-29 23:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671641   8 58451 86178041 A  ERROR'
2018-11-29 23:56:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:56:18 [DEBUG   ] spawn_process: at 2018-11-29 23:56:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:56:25 [DEBUG   ] Got command BAM from MCS: ref #671645
2018-11-29 23:56:25 [INFO    ] Finished processing BAM request
2018-11-29 23:56:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671645   8 58451 86185033 A  ERROR'
2018-11-29 23:56:25 [DEBUG   ] Got command BAM from MCS: ref #671644
2018-11-29 23:56:25 [INFO    ] Finished processing BAM request
2018-11-29 23:56:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671644   8 58451 86185041 A  ERROR'
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:56:25 [DEBUG   ] spawn_process: at 2018-11-29 23:56:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:56:32 [DEBUG   ] Got command BAM from MCS: ref #671646
2018-11-29 23:56:32 [INFO    ] Finished processing BAM request
2018-11-29 23:56:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671646   8 58451 86192025 A  ERROR'
2018-11-29 23:56:32 [DEBUG   ] Got command BAM from MCS: ref #671647
2018-11-29 23:56:32 [INFO    ] Finished processing BAM request
2018-11-29 23:56:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671647   8 58451 86192029 A  ERROR'
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:56:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:56:32 [DEBUG   ] spawn_process: at 2018-11-29 23:56:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:56:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 23:56:39 [DEBUG   ] Got command BAM from MCS: ref #671648
2018-11-29 23:56:39 [INFO    ] Finished processing BAM request
2018-11-29 23:56:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671648   8 58451 86199029 A  ERROR'
2018-11-29 23:56:39 [DEBUG   ] Got command BAM from MCS: ref #671649
2018-11-29 23:56:39 [INFO    ] Finished processing BAM request
2018-11-29 23:56:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671649   8 58451 86199033 A  ERROR'
2018-11-29 23:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:56:39 [DEBUG   ] spawn_process: at 2018-11-29 23:56:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:56:40 [DEBUG   ] spawn_process: at 2018-11-29 23:56:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:56:46 [DEBUG   ] Got command BAM from MCS: ref #671650
2018-11-29 23:56:46 [INFO    ] Finished processing BAM request
2018-11-29 23:56:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671650   8 58451 86206025 A  ERROR'
2018-11-29 23:56:46 [DEBUG   ] Got command BAM from MCS: ref #671651
2018-11-29 23:56:46 [INFO    ] Finished processing BAM request
2018-11-29 23:56:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671651   8 58451 86206029 A  ERROR'
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:56:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:56:46 [DEBUG   ] spawn_process: at 2018-11-29 23:56:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:56:53 [DEBUG   ] Got command BAM from MCS: ref #671652
2018-11-29 23:56:53 [INFO    ] Finished processing BAM request
2018-11-29 23:56:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671652   8 58451 86213025 A  ERROR'
2018-11-29 23:56:53 [DEBUG   ] Got command BAM from MCS: ref #671653
2018-11-29 23:56:53 [INFO    ] Finished processing BAM request
2018-11-29 23:56:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671653   8 58451 86213029 A  ERROR'
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:56:53 [DEBUG   ] spawn_process: at 2018-11-29 23:56:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:56:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:56:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:56:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-29 23:56:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:56:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:56:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:56:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:56:56 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-29 23:56:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:57:00 [DEBUG   ] Got command BAM from MCS: ref #671655
2018-11-29 23:57:00 [INFO    ] Finished processing BAM request
2018-11-29 23:57:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671655   8 58451 86220025 A  ERROR'
2018-11-29 23:57:00 [DEBUG   ] Got command BAM from MCS: ref #671654
2018-11-29 23:57:00 [INFO    ] Finished processing BAM request
2018-11-29 23:57:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671654   8 58451 86220029 A  ERROR'
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:57:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:57:00 [DEBUG   ] spawn_process: at 2018-11-29 23:57:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:57:07 [DEBUG   ] Got command BAM from MCS: ref #671656
2018-11-29 23:57:07 [INFO    ] Finished processing BAM request
2018-11-29 23:57:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671656   8 58451 86227037 A  ERROR'
2018-11-29 23:57:07 [DEBUG   ] Got command BAM from MCS: ref #671657
2018-11-29 23:57:07 [INFO    ] Finished processing BAM request
2018-11-29 23:57:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671657   8 58451 86227045 A  ERROR'
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:57:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:57:07 [DEBUG   ] spawn_process: at 2018-11-29 23:57:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:57:14 [DEBUG   ] Got command BAM from MCS: ref #671658
2018-11-29 23:57:14 [INFO    ] Finished processing BAM request
2018-11-29 23:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671658   8 58451 86234033 A  ERROR'
2018-11-29 23:57:14 [DEBUG   ] Got command BAM from MCS: ref #671659
2018-11-29 23:57:14 [INFO    ] Finished processing BAM request
2018-11-29 23:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671659   8 58451 86234037 A  ERROR'
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:57:14 [DEBUG   ] spawn_process: at 2018-11-29 23:57:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:57:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:57:21 [DEBUG   ] Got command BAM from MCS: ref #671661
2018-11-29 23:57:21 [INFO    ] Finished processing BAM request
2018-11-29 23:57:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671661   8 58451 86241025 A  ERROR'
2018-11-29 23:57:21 [DEBUG   ] Got command BAM from MCS: ref #671660
2018-11-29 23:57:21 [INFO    ] Finished processing BAM request
2018-11-29 23:57:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671660   8 58451 86241029 A  ERROR'
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:57:21 [DEBUG   ] spawn_process: at 2018-11-29 23:57:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:57:28 [DEBUG   ] Got command BAM from MCS: ref #671662
2018-11-29 23:57:28 [INFO    ] Finished processing BAM request
2018-11-29 23:57:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671662   8 58451 86248029 A  ERROR'
2018-11-29 23:57:28 [DEBUG   ] Got command BAM from MCS: ref #671663
2018-11-29 23:57:28 [INFO    ] Finished processing BAM request
2018-11-29 23:57:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671663   8 58451 86248033 A  ERROR'
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:57:28 [DEBUG   ] spawn_process: at 2018-11-29 23:57:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:57:35 [DEBUG   ] Got command BAM from MCS: ref #671665
2018-11-29 23:57:35 [INFO    ] Finished processing BAM request
2018-11-29 23:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671665   8 58451 86255025 A  ERROR'
2018-11-29 23:57:35 [DEBUG   ] Got command BAM from MCS: ref #671664
2018-11-29 23:57:35 [INFO    ] Finished processing BAM request
2018-11-29 23:57:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671664   8 58451 86255029 A  ERROR'
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:57:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:57:35 [DEBUG   ] spawn_process: at 2018-11-29 23:57:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:57:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:57:42 [DEBUG   ] Got command BAM from MCS: ref #671667
2018-11-29 23:57:42 [INFO    ] Finished processing BAM request
2018-11-29 23:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671667   8 58451 86262033 A  ERROR'
2018-11-29 23:57:42 [DEBUG   ] Got command BAM from MCS: ref #671666
2018-11-29 23:57:42 [INFO    ] Finished processing BAM request
2018-11-29 23:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671666   8 58451 86262037 A  ERROR'
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:57:42 [DEBUG   ] spawn_process: at 2018-11-29 23:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:57:49 [DEBUG   ] Got command BAM from MCS: ref #671668
2018-11-29 23:57:49 [INFO    ] Finished processing BAM request
2018-11-29 23:57:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671668   8 58451 86269029 A  ERROR'
2018-11-29 23:57:49 [DEBUG   ] Got command BAM from MCS: ref #671669
2018-11-29 23:57:49 [INFO    ] Finished processing BAM request
2018-11-29 23:57:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671669   8 58451 86269033 A  ERROR'
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:57:49 [DEBUG   ] spawn_process: at 2018-11-29 23:57:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:57:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-29 23:57:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-29 23:57:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:57:56 [DEBUG   ] Got command BAM from MCS: ref #671671
2018-11-29 23:57:56 [INFO    ] Finished processing BAM request
2018-11-29 23:57:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671671   8 58451 86276025 A  ERROR'
2018-11-29 23:57:56 [DEBUG   ] Got command BAM from MCS: ref #671670
2018-11-29 23:57:56 [INFO    ] Finished processing BAM request
2018-11-29 23:57:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:57:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671670   8 58451 86276029 A  ERROR'
2018-11-29 23:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-29 23:57:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:57:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:57:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:57:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:57:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:57:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:57:56 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:57:56 [DEBUG   ] spawn_process: at 2018-11-29 23:57:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:57:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 23:58:03 [DEBUG   ] Got command BAM from MCS: ref #671672
2018-11-29 23:58:03 [INFO    ] Finished processing BAM request
2018-11-29 23:58:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671672   8 58451 86283033 A  ERROR'
2018-11-29 23:58:03 [DEBUG   ] Got command BAM from MCS: ref #671673
2018-11-29 23:58:03 [INFO    ] Finished processing BAM request
2018-11-29 23:58:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671673   8 58451 86283037 A  ERROR'
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:58:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:58:03 [DEBUG   ] spawn_process: at 2018-11-29 23:58:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:58:10 [DEBUG   ] Got command BAM from MCS: ref #671674
2018-11-29 23:58:10 [INFO    ] Finished processing BAM request
2018-11-29 23:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671674   8 58451 86290025 A  ERROR'
2018-11-29 23:58:10 [DEBUG   ] Got command BAM from MCS: ref #671675
2018-11-29 23:58:10 [INFO    ] Finished processing BAM request
2018-11-29 23:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671675   8 58451 86290029 A  ERROR'
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:58:10 [DEBUG   ] spawn_process: at 2018-11-29 23:58:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:58:17 [DEBUG   ] Got command BAM from MCS: ref #671677
2018-11-29 23:58:17 [INFO    ] Finished processing BAM request
2018-11-29 23:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671677   8 58451 86297033 A  ERROR'
2018-11-29 23:58:17 [DEBUG   ] Got command BAM from MCS: ref #671676
2018-11-29 23:58:17 [INFO    ] Finished processing BAM request
2018-11-29 23:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671676   8 58451 86297041 A  ERROR'
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:58:17 [DEBUG   ] spawn_process: at 2018-11-29 23:58:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:58:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:58:24 [DEBUG   ] Got command BAM from MCS: ref #671679
2018-11-29 23:58:24 [INFO    ] Finished processing BAM request
2018-11-29 23:58:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671679   8 58451 86304033 A  ERROR'
2018-11-29 23:58:24 [DEBUG   ] Got command BAM from MCS: ref #671678
2018-11-29 23:58:24 [INFO    ] Finished processing BAM request
2018-11-29 23:58:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671678   8 58451 86304037 A  ERROR'
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:58:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:58:24 [DEBUG   ] spawn_process: at 2018-11-29 23:58:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:58:31 [DEBUG   ] Got command BAM from MCS: ref #671680
2018-11-29 23:58:31 [INFO    ] Finished processing BAM request
2018-11-29 23:58:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671680   8 58451 86311025 A  ERROR'
2018-11-29 23:58:31 [DEBUG   ] Got command BAM from MCS: ref #671681
2018-11-29 23:58:31 [INFO    ] Finished processing BAM request
2018-11-29 23:58:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671681   8 58451 86311029 A  ERROR'
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:58:31 [DEBUG   ] spawn_process: at 2018-11-29 23:58:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:58:38 [DEBUG   ] Got command BAM from MCS: ref #671683
2018-11-29 23:58:38 [INFO    ] Finished processing BAM request
2018-11-29 23:58:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671683   8 58451 86318025 A  ERROR'
2018-11-29 23:58:38 [DEBUG   ] Got command BAM from MCS: ref #671682
2018-11-29 23:58:38 [INFO    ] Finished processing BAM request
2018-11-29 23:58:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671682   8 58451 86318029 A  ERROR'
2018-11-29 23:58:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:58:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:58:38 [DEBUG   ] spawn_process: at 2018-11-29 23:58:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:58:45 [DEBUG   ] Got command BAM from MCS: ref #671684
2018-11-29 23:58:45 [INFO    ] Finished processing BAM request
2018-11-29 23:58:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671684   8 58451 86325033 A  ERROR'
2018-11-29 23:58:45 [DEBUG   ] Got command BAM from MCS: ref #671685
2018-11-29 23:58:45 [INFO    ] Finished processing BAM request
2018-11-29 23:58:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671685   8 58451 86325041 A  ERROR'
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:58:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:58:45 [DEBUG   ] spawn_process: at 2018-11-29 23:58:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:58:52 [DEBUG   ] Got command BAM from MCS: ref #671687
2018-11-29 23:58:52 [INFO    ] Finished processing BAM request
2018-11-29 23:58:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671687   8 58451 86332025 A  ERROR'
2018-11-29 23:58:52 [DEBUG   ] Got command BAM from MCS: ref #671686
2018-11-29 23:58:52 [INFO    ] Finished processing BAM request
2018-11-29 23:58:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671686   8 58451 86332029 A  ERROR'
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:58:52 [DEBUG   ] spawn_process: at 2018-11-29 23:58:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-29 23:58:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:58:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:58:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-29 23:58:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:58:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:58:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:58:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:58:56 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-11-29 23:58:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 23:58:59 [DEBUG   ] Got command BAM from MCS: ref #671689
2018-11-29 23:58:59 [INFO    ] Finished processing BAM request
2018-11-29 23:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671689   8 58451 86339041 A  ERROR'
2018-11-29 23:58:59 [DEBUG   ] Got command BAM from MCS: ref #671688
2018-11-29 23:58:59 [INFO    ] Finished processing BAM request
2018-11-29 23:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671688   8 58451 86339045 A  ERROR'
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:58:59 [DEBUG   ] spawn_process: at 2018-11-29 23:58:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:59:04 [DEBUG   ] Got command RPT from MCS: ref #671690
2018-11-29 23:59:04 [DEBUG   ] summary = ERROR
2018-11-29 23:59:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671690  13 58451 86344865 A  ERRORERROR'
2018-11-29 23:59:05 [DEBUG   ] Got command RPT from MCS: ref #671693
2018-11-29 23:59:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671693  77 58451 86345069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:59:05 [DEBUG   ] Got command RPT from MCS: ref #671694
2018-11-29 23:59:05 [DEBUG   ] summary = ERROR
2018-11-29 23:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671694  13 58451 86345261 A  ERRORERROR'
2018-11-29 23:59:05 [DEBUG   ] Got command RPT from MCS: ref #671695
2018-11-29 23:59:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-29 23:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671695  77 58451 86345465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-29 23:59:05 [DEBUG   ] Got command RPT from MCS: ref #671696
2018-11-29 23:59:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-29 23:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671696  12 58451 86345669 A  ERRORB¤ff'
2018-11-29 23:59:06 [DEBUG   ] Got command BAM from MCS: ref #671691
2018-11-29 23:59:06 [INFO    ] Finished processing BAM request
2018-11-29 23:59:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671691   8 58451 86346033 A  ERROR'
2018-11-29 23:59:06 [DEBUG   ] Got command BAM from MCS: ref #671692
2018-11-29 23:59:06 [INFO    ] Finished processing BAM request
2018-11-29 23:59:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671692   8 58451 86346037 A  ERROR'
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-29 23:59:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-29 23:59:06 [DEBUG   ] spawn_process: at 2018-11-29 23:59:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-29 23:59:13 [DEBUG   ] Got command BAM from MCS: ref #671697
2018-11-29 23:59:13 [INFO    ] Finished processing BAM request
2018-11-29 23:59:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671697   8 58451 86353029 A  ERROR'
2018-11-29 23:59:13 [DEBUG   ] Got command BAM from MCS: ref #671698
2018-11-29 23:59:13 [INFO    ] Finished processing BAM request
2018-11-29 23:59:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671698   8 58451 86353033 A  ERROR'
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:59:13 [DEBUG   ] spawn_process: at 2018-11-29 23:59:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:59:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-29 23:59:20 [DEBUG   ] Got command BAM from MCS: ref #671703
2018-11-29 23:59:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671703   8 58451 86360058 A  ERROR'
2018-11-29 23:59:20 [DEBUG   ] Got command BAM from MCS: ref #671704
2018-11-29 23:59:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671704   8 58451 86360062 A  ERROR'
2018-11-29 23:59:20 [INFO    ] Finished processing BAM request
2018-11-29 23:59:20 [INFO    ] Finished processing BAM request
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:59:20 [DEBUG   ] spawn_process: at 2018-11-29 23:59:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:59:27 [DEBUG   ] Got command BAM from MCS: ref #671706
2018-11-29 23:59:27 [INFO    ] Finished processing BAM request
2018-11-29 23:59:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671706   8 58451 86367026 A  ERROR'
2018-11-29 23:59:27 [DEBUG   ] Got command BAM from MCS: ref #671705
2018-11-29 23:59:27 [INFO    ] Finished processing BAM request
2018-11-29 23:59:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671705   8 58451 86367030 A  ERROR'
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:59:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:59:27 [DEBUG   ] spawn_process: at 2018-11-29 23:59:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:59:34 [DEBUG   ] Got command BAM from MCS: ref #671707
2018-11-29 23:59:34 [INFO    ] Finished processing BAM request
2018-11-29 23:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671707   8 58451 86374034 A  ERROR'
2018-11-29 23:59:34 [DEBUG   ] Got command BAM from MCS: ref #671708
2018-11-29 23:59:34 [INFO    ] Finished processing BAM request
2018-11-29 23:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671708   8 58451 86374038 A  ERROR'
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-29 23:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-29 23:59:34 [DEBUG   ] spawn_process: at 2018-11-29 23:59:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-29 23:59:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-29 23:59:41 [DEBUG   ] Got command BAM from MCS: ref #671710
2018-11-29 23:59:41 [INFO    ] Finished processing BAM request
2018-11-29 23:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671710   8 58451 86381030 A  ERROR'
2018-11-29 23:59:41 [DEBUG   ] Got command BAM from MCS: ref #671709
2018-11-29 23:59:41 [INFO    ] Finished processing BAM request
2018-11-29 23:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671709   8 58451 86381034 A  ERROR'
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-29 23:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-29 23:59:41 [DEBUG   ] spawn_process: at 2018-11-29 23:59:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-29 23:59:48 [DEBUG   ] Got command BAM from MCS: ref #671711
2018-11-29 23:59:48 [INFO    ] Finished processing BAM request
2018-11-29 23:59:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671711   8 58451 86388034 A  ERROR'
2018-11-29 23:59:48 [DEBUG   ] Got command BAM from MCS: ref #671712
2018-11-29 23:59:48 [INFO    ] Finished processing BAM request
2018-11-29 23:59:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671712   8 58451 86388038 A  ERROR'
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-29 23:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-29 23:59:48 [DEBUG   ] spawn_process: at 2018-11-29 23:59:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-29 23:59:55 [DEBUG   ] Got command BAM from MCS: ref #671713
2018-11-29 23:59:55 [INFO    ] Finished processing BAM request
2018-11-29 23:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671713   8 58451 86395026 A  ERROR'
2018-11-29 23:59:55 [DEBUG   ] Got command BAM from MCS: ref #671714
2018-11-29 23:59:55 [INFO    ] Finished processing BAM request
2018-11-29 23:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-29 23:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671714   8 58451 86395030 A  ERROR'
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-29 23:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-29 23:59:55 [DEBUG   ] spawn_process: at 2018-11-29 23:59:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-29 23:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-29 23:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-29 23:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-29 23:59:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-29 23:59:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-29 23:59:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:59:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:59:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:59:56 [WARNING ] (13, 1, 'bot')
2018-11-29 23:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-29 23:59:56 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-29 23:59:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 00:00:02 [DEBUG   ] Got command BAM from MCS: ref #671716
2018-11-30 00:00:02 [INFO    ] Finished processing BAM request
2018-11-30 00:00:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671716   8 58452     2030 A  ERROR'
2018-11-30 00:00:02 [DEBUG   ] Got command BAM from MCS: ref #671715
2018-11-30 00:00:02 [INFO    ] Finished processing BAM request
2018-11-30 00:00:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671715   8 58452     2034 A  ERROR'
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:00:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:00:02 [DEBUG   ] spawn_process: at 2018-11-30 00:00:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:00:09 [DEBUG   ] Got command BAM from MCS: ref #671717
2018-11-30 00:00:09 [INFO    ] Finished processing BAM request
2018-11-30 00:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671717   8 58452     9034 A  ERROR'
2018-11-30 00:00:09 [DEBUG   ] Got command BAM from MCS: ref #671718
2018-11-30 00:00:09 [INFO    ] Finished processing BAM request
2018-11-30 00:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671718   8 58452     9038 A  ERROR'
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:00:09 [DEBUG   ] spawn_process: at 2018-11-30 00:00:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:00:16 [DEBUG   ] Got command BAM from MCS: ref #671720
2018-11-30 00:00:16 [INFO    ] Finished processing BAM request
2018-11-30 00:00:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671720   8 58452    16026 A  ERROR'
2018-11-30 00:00:16 [DEBUG   ] Got command BAM from MCS: ref #671719
2018-11-30 00:00:16 [INFO    ] Finished processing BAM request
2018-11-30 00:00:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671719   8 58452    16030 A  ERROR'
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:00:16 [DEBUG   ] spawn_process: at 2018-11-30 00:00:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:00:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:00:23 [DEBUG   ] Got command BAM from MCS: ref #671721
2018-11-30 00:00:23 [INFO    ] Finished processing BAM request
2018-11-30 00:00:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671721   8 58452    23033 A  ERROR'
2018-11-30 00:00:23 [DEBUG   ] Got command BAM from MCS: ref #671722
2018-11-30 00:00:23 [INFO    ] Finished processing BAM request
2018-11-30 00:00:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671722   8 58452    23037 A  ERROR'
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:00:23 [DEBUG   ] spawn_process: at 2018-11-30 00:00:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:00:30 [DEBUG   ] Got command BAM from MCS: ref #671723
2018-11-30 00:00:30 [INFO    ] Finished processing BAM request
2018-11-30 00:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671723   8 58452    30029 A  ERROR'
2018-11-30 00:00:30 [DEBUG   ] Got command BAM from MCS: ref #671724
2018-11-30 00:00:30 [INFO    ] Finished processing BAM request
2018-11-30 00:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671724   8 58452    30033 A  ERROR'
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:00:30 [DEBUG   ] spawn_process: at 2018-11-30 00:00:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:00:37 [DEBUG   ] Got command BAM from MCS: ref #671725
2018-11-30 00:00:37 [INFO    ] Finished processing BAM request
2018-11-30 00:00:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671725   8 58452    37029 A  ERROR'
2018-11-30 00:00:37 [DEBUG   ] Got command BAM from MCS: ref #671726
2018-11-30 00:00:37 [INFO    ] Finished processing BAM request
2018-11-30 00:00:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671726   8 58452    37033 A  ERROR'
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:00:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:00:37 [DEBUG   ] spawn_process: at 2018-11-30 00:00:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:00:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:00:44 [DEBUG   ] Got command BAM from MCS: ref #671728
2018-11-30 00:00:44 [INFO    ] Finished processing BAM request
2018-11-30 00:00:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671728   8 58452    44029 A  ERROR'
2018-11-30 00:00:44 [DEBUG   ] Got command BAM from MCS: ref #671727
2018-11-30 00:00:44 [INFO    ] Finished processing BAM request
2018-11-30 00:00:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671727   8 58452    44033 A  ERROR'
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:00:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:00:44 [DEBUG   ] spawn_process: at 2018-11-30 00:00:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:00:49 [DEBUG   ] Got command RPT from MCS: ref #671729
2018-11-30 00:00:49 [DEBUG   ] summary = ERROR
2018-11-30 00:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671729  13 58452    49837 A  ERRORERROR'
2018-11-30 00:00:49 [DEBUG   ] Got command RPT from MCS: ref #671730
2018-11-30 00:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671730  77 58452    49838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:00:51 [DEBUG   ] Got command BAM from MCS: ref #671746
2018-11-30 00:00:51 [INFO    ] Finished processing BAM request
2018-11-30 00:00:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671746   8 58452    51029 A  ERROR'
2018-11-30 00:00:51 [DEBUG   ] Got command BAM from MCS: ref #671747
2018-11-30 00:00:51 [INFO    ] Finished processing BAM request
2018-11-30 00:00:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671747   8 58452    51033 A  ERROR'
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:00:51 [DEBUG   ] spawn_process: at 2018-11-30 00:00:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:00:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:00:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-30 00:00:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-30 00:00:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:00:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:00:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:00:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:00:56 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-30 00:00:58 [DEBUG   ] Got command BAM from MCS: ref #671748
2018-11-30 00:00:58 [INFO    ] Finished processing BAM request
2018-11-30 00:00:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671748   8 58452    58034 A  ERROR'
2018-11-30 00:00:58 [DEBUG   ] Got command BAM from MCS: ref #671749
2018-11-30 00:00:58 [INFO    ] Finished processing BAM request
2018-11-30 00:00:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671749   8 58452    58038 A  ERROR'
2018-11-30 00:00:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:00:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:00:58 [DEBUG   ] spawn_process: at 2018-11-30 00:00:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:01:05 [DEBUG   ] Got command BAM from MCS: ref #671751
2018-11-30 00:01:05 [INFO    ] Finished processing BAM request
2018-11-30 00:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671751   8 58452    65026 A  ERROR'
2018-11-30 00:01:05 [DEBUG   ] Got command BAM from MCS: ref #671750
2018-11-30 00:01:05 [INFO    ] Finished processing BAM request
2018-11-30 00:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671750   8 58452    65030 A  ERROR'
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:01:05 [DEBUG   ] spawn_process: at 2018-11-30 00:01:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:01:12 [DEBUG   ] Got command BAM from MCS: ref #671752
2018-11-30 00:01:12 [INFO    ] Finished processing BAM request
2018-11-30 00:01:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671752   8 58452    72029 A  ERROR'
2018-11-30 00:01:12 [DEBUG   ] Got command BAM from MCS: ref #671753
2018-11-30 00:01:12 [INFO    ] Finished processing BAM request
2018-11-30 00:01:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671753   8 58452    72033 A  ERROR'
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:01:12 [DEBUG   ] spawn_process: at 2018-11-30 00:01:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:01:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:01:19 [DEBUG   ] Got command BAM from MCS: ref #671754
2018-11-30 00:01:19 [INFO    ] Finished processing BAM request
2018-11-30 00:01:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671754   8 58452    79033 A  ERROR'
2018-11-30 00:01:19 [DEBUG   ] Got command BAM from MCS: ref #671755
2018-11-30 00:01:19 [INFO    ] Finished processing BAM request
2018-11-30 00:01:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671755   8 58452    79037 A  ERROR'
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:01:20 [DEBUG   ] spawn_process: at 2018-11-30 00:01:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:01:26 [DEBUG   ] Got command BAM from MCS: ref #671757
2018-11-30 00:01:26 [INFO    ] Finished processing BAM request
2018-11-30 00:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671757   8 58452    86029 A  ERROR'
2018-11-30 00:01:26 [DEBUG   ] Got command BAM from MCS: ref #671756
2018-11-30 00:01:26 [INFO    ] Finished processing BAM request
2018-11-30 00:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671756   8 58452    86033 A  ERROR'
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:01:26 [DEBUG   ] spawn_process: at 2018-11-30 00:01:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:01:33 [DEBUG   ] Got command BAM from MCS: ref #671759
2018-11-30 00:01:33 [INFO    ] Finished processing BAM request
2018-11-30 00:01:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671759   8 58452    93025 A  ERROR'
2018-11-30 00:01:33 [DEBUG   ] Got command BAM from MCS: ref #671758
2018-11-30 00:01:33 [INFO    ] Finished processing BAM request
2018-11-30 00:01:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671758   8 58452    93029 A  ERROR'
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:01:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:01:33 [DEBUG   ] spawn_process: at 2018-11-30 00:01:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:01:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 00:01:40 [DEBUG   ] Got command BAM from MCS: ref #671760
2018-11-30 00:01:40 [INFO    ] Finished processing BAM request
2018-11-30 00:01:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671760   8 58452   100029 A  ERROR'
2018-11-30 00:01:40 [DEBUG   ] Got command BAM from MCS: ref #671761
2018-11-30 00:01:40 [INFO    ] Finished processing BAM request
2018-11-30 00:01:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671761   8 58452   100033 A  ERROR'
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:01:40 [DEBUG   ] spawn_process: at 2018-11-30 00:01:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:01:47 [DEBUG   ] Got command BAM from MCS: ref #671763
2018-11-30 00:01:47 [INFO    ] Finished processing BAM request
2018-11-30 00:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671763   8 58452   107025 A  ERROR'
2018-11-30 00:01:47 [DEBUG   ] Got command BAM from MCS: ref #671762
2018-11-30 00:01:47 [INFO    ] Finished processing BAM request
2018-11-30 00:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671762   8 58452   107029 A  ERROR'
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:01:47 [DEBUG   ] spawn_process: at 2018-11-30 00:01:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:01:54 [DEBUG   ] Got command BAM from MCS: ref #671765
2018-11-30 00:01:54 [INFO    ] Finished processing BAM request
2018-11-30 00:01:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671765   8 58452   114033 A  ERROR'
2018-11-30 00:01:54 [DEBUG   ] Got command BAM from MCS: ref #671764
2018-11-30 00:01:54 [INFO    ] Finished processing BAM request
2018-11-30 00:01:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671764   8 58452   114037 A  ERROR'
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:01:54 [DEBUG   ] spawn_process: at 2018-11-30 00:01:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 00:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:01:56 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:01:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:01:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:01:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:01:56 [WARNING ] (13, 1, 'bot')
2018-11-30 00:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:01:56 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-30 00:01:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:02:01 [DEBUG   ] Got command BAM from MCS: ref #671767
2018-11-30 00:02:01 [INFO    ] Finished processing BAM request
2018-11-30 00:02:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671767   8 58452   121033 A  ERROR'
2018-11-30 00:02:01 [DEBUG   ] Got command BAM from MCS: ref #671766
2018-11-30 00:02:01 [INFO    ] Finished processing BAM request
2018-11-30 00:02:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671766   8 58452   121041 A  ERROR'
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:02:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:02:01 [DEBUG   ] spawn_process: at 2018-11-30 00:02:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:02:08 [DEBUG   ] Got command BAM from MCS: ref #671769
2018-11-30 00:02:08 [INFO    ] Finished processing BAM request
2018-11-30 00:02:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671769   8 58452   128025 A  ERROR'
2018-11-30 00:02:08 [DEBUG   ] Got command BAM from MCS: ref #671768
2018-11-30 00:02:08 [INFO    ] Finished processing BAM request
2018-11-30 00:02:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671768   8 58452   128029 A  ERROR'
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:02:08 [DEBUG   ] spawn_process: at 2018-11-30 00:02:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:02:15 [DEBUG   ] Got command BAM from MCS: ref #671771
2018-11-30 00:02:15 [INFO    ] Finished processing BAM request
2018-11-30 00:02:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671771   8 58452   135033 A  ERROR'
2018-11-30 00:02:15 [DEBUG   ] Got command BAM from MCS: ref #671770
2018-11-30 00:02:15 [INFO    ] Finished processing BAM request
2018-11-30 00:02:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671770   8 58452   135037 A  ERROR'
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:02:15 [DEBUG   ] spawn_process: at 2018-11-30 00:02:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:02:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 00:02:22 [DEBUG   ] Got command BAM from MCS: ref #671777
2018-11-30 00:02:22 [INFO    ] Finished processing BAM request
2018-11-30 00:02:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671777   8 58452   142025 A  ERROR'
2018-11-30 00:02:22 [DEBUG   ] Got command BAM from MCS: ref #671776
2018-11-30 00:02:22 [INFO    ] Finished processing BAM request
2018-11-30 00:02:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671776   8 58452   142029 A  ERROR'
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:02:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:02:22 [DEBUG   ] spawn_process: at 2018-11-30 00:02:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:02:29 [DEBUG   ] Got command BAM from MCS: ref #671779
2018-11-30 00:02:29 [INFO    ] Finished processing BAM request
2018-11-30 00:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671779   8 58452   149029 A  ERROR'
2018-11-30 00:02:29 [DEBUG   ] Got command BAM from MCS: ref #671778
2018-11-30 00:02:29 [INFO    ] Finished processing BAM request
2018-11-30 00:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671778   8 58452   149033 A  ERROR'
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:02:29 [DEBUG   ] spawn_process: at 2018-11-30 00:02:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:02:36 [DEBUG   ] Got command BAM from MCS: ref #671780
2018-11-30 00:02:36 [INFO    ] Finished processing BAM request
2018-11-30 00:02:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671780   8 58452   156025 A  ERROR'
2018-11-30 00:02:36 [DEBUG   ] Got command BAM from MCS: ref #671781
2018-11-30 00:02:36 [INFO    ] Finished processing BAM request
2018-11-30 00:02:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671781   8 58452   156029 A  ERROR'
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:02:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:02:36 [DEBUG   ] spawn_process: at 2018-11-30 00:02:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:02:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 00:02:44 [DEBUG   ] Got command BAM from MCS: ref #671783
2018-11-30 00:02:44 [INFO    ] Finished processing BAM request
2018-11-30 00:02:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671783   8 58452   164033 A  ERROR'
2018-11-30 00:02:44 [DEBUG   ] Got command BAM from MCS: ref #671782
2018-11-30 00:02:44 [INFO    ] Finished processing BAM request
2018-11-30 00:02:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671782   8 58452   164037 A  ERROR'
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:02:44 [DEBUG   ] spawn_process: at 2018-11-30 00:02:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:02:52 [DEBUG   ] Got command BAM from MCS: ref #671784
2018-11-30 00:02:52 [INFO    ] Finished processing BAM request
2018-11-30 00:02:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671784   8 58452   172025 A  ERROR'
2018-11-30 00:02:52 [DEBUG   ] Got command BAM from MCS: ref #671785
2018-11-30 00:02:52 [INFO    ] Finished processing BAM request
2018-11-30 00:02:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:02:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671785   8 58452   172029 A  ERROR'
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:02:52 [DEBUG   ] spawn_process: at 2018-11-30 00:02:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:02:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-30 00:02:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:02:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:02:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:02:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:02:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:02:57 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-30 00:02:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:03:00 [DEBUG   ] Got command BAM from MCS: ref #671786
2018-11-30 00:03:00 [INFO    ] Finished processing BAM request
2018-11-30 00:03:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671786   8 58452   180033 A  ERROR'
2018-11-30 00:03:00 [DEBUG   ] Got command BAM from MCS: ref #671787
2018-11-30 00:03:00 [INFO    ] Finished processing BAM request
2018-11-30 00:03:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671787   8 58452   180037 A  ERROR'
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:03:00 [DEBUG   ] spawn_process: at 2018-11-30 00:03:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:03:08 [DEBUG   ] Got command BAM from MCS: ref #671789
2018-11-30 00:03:08 [INFO    ] Finished processing BAM request
2018-11-30 00:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671789   8 58452   188025 A  ERROR'
2018-11-30 00:03:08 [DEBUG   ] Got command BAM from MCS: ref #671788
2018-11-30 00:03:08 [INFO    ] Finished processing BAM request
2018-11-30 00:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671788   8 58452   188029 A  ERROR'
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:03:08 [DEBUG   ] spawn_process: at 2018-11-30 00:03:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:03:16 [DEBUG   ] Got command BAM from MCS: ref #671790
2018-11-30 00:03:16 [INFO    ] Finished processing BAM request
2018-11-30 00:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671790   8 58452   196033 A  ERROR'
2018-11-30 00:03:16 [DEBUG   ] Got command BAM from MCS: ref #671791
2018-11-30 00:03:16 [INFO    ] Finished processing BAM request
2018-11-30 00:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671791   8 58452   196037 A  ERROR'
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:03:16 [DEBUG   ] spawn_process: at 2018-11-30 00:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:03:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 00:03:24 [DEBUG   ] Got command BAM from MCS: ref #671793
2018-11-30 00:03:24 [INFO    ] Finished processing BAM request
2018-11-30 00:03:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671793   8 58452   204025 A  ERROR'
2018-11-30 00:03:24 [DEBUG   ] Got command BAM from MCS: ref #671792
2018-11-30 00:03:24 [INFO    ] Finished processing BAM request
2018-11-30 00:03:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671792   8 58452   204029 A  ERROR'
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:03:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:03:24 [DEBUG   ] spawn_process: at 2018-11-30 00:03:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:03:32 [DEBUG   ] Got command BAM from MCS: ref #671794
2018-11-30 00:03:32 [INFO    ] Finished processing BAM request
2018-11-30 00:03:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671794   8 58452   212025 A  ERROR'
2018-11-30 00:03:32 [DEBUG   ] Got command BAM from MCS: ref #671795
2018-11-30 00:03:32 [INFO    ] Finished processing BAM request
2018-11-30 00:03:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671795   8 58452   212029 A  ERROR'
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:03:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:03:32 [DEBUG   ] spawn_process: at 2018-11-30 00:03:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:03:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:03:40 [DEBUG   ] Got command BAM from MCS: ref #671797
2018-11-30 00:03:40 [INFO    ] Finished processing BAM request
2018-11-30 00:03:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671797   8 58452   220029 A  ERROR'
2018-11-30 00:03:40 [DEBUG   ] Got command BAM from MCS: ref #671796
2018-11-30 00:03:40 [INFO    ] Finished processing BAM request
2018-11-30 00:03:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671796   8 58452   220033 A  ERROR'
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:03:40 [DEBUG   ] spawn_process: at 2018-11-30 00:03:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:03:48 [DEBUG   ] Got command BAM from MCS: ref #671800
2018-11-30 00:03:48 [INFO    ] Finished processing BAM request
2018-11-30 00:03:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671800   8 58452   228029 A  ERROR'
2018-11-30 00:03:48 [DEBUG   ] Got command BAM from MCS: ref #671801
2018-11-30 00:03:48 [INFO    ] Finished processing BAM request
2018-11-30 00:03:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671801   8 58452   228033 A  ERROR'
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:03:48 [DEBUG   ] spawn_process: at 2018-11-30 00:03:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:03:56 [DEBUG   ] Got command BAM from MCS: ref #671803
2018-11-30 00:03:56 [INFO    ] Finished processing BAM request
2018-11-30 00:03:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671803   8 58452   236033 A  ERROR'
2018-11-30 00:03:56 [DEBUG   ] Got command BAM from MCS: ref #671802
2018-11-30 00:03:56 [INFO    ] Finished processing BAM request
2018-11-30 00:03:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671802   8 58452   236037 A  ERROR'
2018-11-30 00:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:03:56 [DEBUG   ] spawn_process: at 2018-11-30 00:03:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:03:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-30 00:03:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:03:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:03:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:03:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:03:57 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-30 00:03:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:04:04 [DEBUG   ] Got command BAM from MCS: ref #671804
2018-11-30 00:04:04 [INFO    ] Finished processing BAM request
2018-11-30 00:04:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671804   8 58452   244025 A  ERROR'
2018-11-30 00:04:04 [DEBUG   ] Got command BAM from MCS: ref #671805
2018-11-30 00:04:04 [INFO    ] Finished processing BAM request
2018-11-30 00:04:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671805   8 58452   244029 A  ERROR'
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:04:04 [DEBUG   ] Got command RPT from MCS: ref #671806
2018-11-30 00:04:04 [DEBUG   ] summary = ERROR
2018-11-30 00:04:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671806  13 58452   244945 A  ERRORERROR'
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:04:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:04:04 [DEBUG   ] spawn_process: at 2018-11-30 00:04:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:04:05 [DEBUG   ] Got command RPT from MCS: ref #671807
2018-11-30 00:04:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671807  77 58452   245153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:04:05 [DEBUG   ] Got command RPT from MCS: ref #671808
2018-11-30 00:04:05 [DEBUG   ] summary = ERROR
2018-11-30 00:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671808  13 58452   245349 A  ERRORERROR'
2018-11-30 00:04:05 [DEBUG   ] Got command RPT from MCS: ref #671810
2018-11-30 00:04:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671810  77 58452   245553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:04:05 [DEBUG   ] Got command RPT from MCS: ref #671811
2018-11-30 00:04:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671811  12 58452   245757 A  ERRORB£ff'
2018-11-30 00:04:12 [DEBUG   ] Got command BAM from MCS: ref #671817
2018-11-30 00:04:12 [INFO    ] Finished processing BAM request
2018-11-30 00:04:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671817   8 58452   252029 A  ERROR'
2018-11-30 00:04:12 [DEBUG   ] Got command BAM from MCS: ref #671816
2018-11-30 00:04:12 [INFO    ] Finished processing BAM request
2018-11-30 00:04:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671816   8 58452   252033 A  ERROR'
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:04:12 [DEBUG   ] spawn_process: at 2018-11-30 00:04:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:04:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:04:20 [DEBUG   ] Got command BAM from MCS: ref #671819
2018-11-30 00:04:20 [INFO    ] Finished processing BAM request
2018-11-30 00:04:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671819   8 58452   260029 A  ERROR'
2018-11-30 00:04:20 [DEBUG   ] Got command BAM from MCS: ref #671818
2018-11-30 00:04:20 [INFO    ] Finished processing BAM request
2018-11-30 00:04:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671818   8 58452   260033 A  ERROR'
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:04:20 [DEBUG   ] spawn_process: at 2018-11-30 00:04:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:04:28 [DEBUG   ] Got command BAM from MCS: ref #671820
2018-11-30 00:04:28 [INFO    ] Finished processing BAM request
2018-11-30 00:04:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671820   8 58452   268029 A  ERROR'
2018-11-30 00:04:28 [DEBUG   ] Got command BAM from MCS: ref #671821
2018-11-30 00:04:28 [INFO    ] Finished processing BAM request
2018-11-30 00:04:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671821   8 58452   268033 A  ERROR'
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:04:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:04:28 [DEBUG   ] spawn_process: at 2018-11-30 00:04:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:04:36 [DEBUG   ] Got command BAM from MCS: ref #671822
2018-11-30 00:04:36 [INFO    ] Finished processing BAM request
2018-11-30 00:04:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671822   8 58452   276033 A  ERROR'
2018-11-30 00:04:36 [DEBUG   ] Got command BAM from MCS: ref #671823
2018-11-30 00:04:36 [INFO    ] Finished processing BAM request
2018-11-30 00:04:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671823   8 58452   276037 A  ERROR'
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:04:36 [DEBUG   ] spawn_process: at 2018-11-30 00:04:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:04:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:04:44 [DEBUG   ] Got command BAM from MCS: ref #671825
2018-11-30 00:04:44 [INFO    ] Finished processing BAM request
2018-11-30 00:04:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671825   8 58452   284025 A  ERROR'
2018-11-30 00:04:44 [DEBUG   ] Got command BAM from MCS: ref #671824
2018-11-30 00:04:44 [INFO    ] Finished processing BAM request
2018-11-30 00:04:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671824   8 58452   284033 A  ERROR'
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:04:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:04:44 [DEBUG   ] spawn_process: at 2018-11-30 00:04:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:04:52 [DEBUG   ] Got command BAM from MCS: ref #671826
2018-11-30 00:04:52 [INFO    ] Finished processing BAM request
2018-11-30 00:04:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671826   8 58452   292033 A  ERROR'
2018-11-30 00:04:52 [DEBUG   ] Got command BAM from MCS: ref #671827
2018-11-30 00:04:52 [INFO    ] Finished processing BAM request
2018-11-30 00:04:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671827   8 58452   292041 A  ERROR'
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:04:52 [DEBUG   ] spawn_process: at 2018-11-30 00:04:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 00:04:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-30 00:04:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:04:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:04:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:04:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:04:57 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-30 00:04:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 00:05:00 [DEBUG   ] Got command BAM from MCS: ref #671828
2018-11-30 00:05:00 [INFO    ] Finished processing BAM request
2018-11-30 00:05:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671828   8 58452   300033 A  ERROR'
2018-11-30 00:05:00 [DEBUG   ] Got command BAM from MCS: ref #671829
2018-11-30 00:05:00 [INFO    ] Finished processing BAM request
2018-11-30 00:05:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671829   8 58452   300037 A  ERROR'
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:05:00 [DEBUG   ] spawn_process: at 2018-11-30 00:05:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:05:08 [DEBUG   ] Got command BAM from MCS: ref #671831
2018-11-30 00:05:08 [INFO    ] Finished processing BAM request
2018-11-30 00:05:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671831   8 58452   308029 A  ERROR'
2018-11-30 00:05:08 [DEBUG   ] Got command BAM from MCS: ref #671830
2018-11-30 00:05:08 [INFO    ] Finished processing BAM request
2018-11-30 00:05:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671830   8 58452   308033 A  ERROR'
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:05:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:05:08 [DEBUG   ] spawn_process: at 2018-11-30 00:05:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:05:16 [DEBUG   ] Got command BAM from MCS: ref #671832
2018-11-30 00:05:16 [INFO    ] Finished processing BAM request
2018-11-30 00:05:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671832   8 58452   316033 A  ERROR'
2018-11-30 00:05:16 [DEBUG   ] Got command BAM from MCS: ref #671833
2018-11-30 00:05:16 [INFO    ] Finished processing BAM request
2018-11-30 00:05:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671833   8 58452   316037 A  ERROR'
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:05:16 [DEBUG   ] spawn_process: at 2018-11-30 00:05:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:05:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:05:24 [DEBUG   ] Got command BAM from MCS: ref #671838
2018-11-30 00:05:24 [INFO    ] Finished processing BAM request
2018-11-30 00:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671838   8 58452   324029 A  ERROR'
2018-11-30 00:05:24 [DEBUG   ] Got command BAM from MCS: ref #671839
2018-11-30 00:05:24 [INFO    ] Finished processing BAM request
2018-11-30 00:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671839   8 58452   324033 A  ERROR'
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:05:24 [DEBUG   ] spawn_process: at 2018-11-30 00:05:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:05:32 [DEBUG   ] Got command BAM from MCS: ref #671841
2018-11-30 00:05:32 [INFO    ] Finished processing BAM request
2018-11-30 00:05:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671841   8 58452   332029 A  ERROR'
2018-11-30 00:05:32 [DEBUG   ] Got command BAM from MCS: ref #671840
2018-11-30 00:05:32 [INFO    ] Finished processing BAM request
2018-11-30 00:05:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671840   8 58452   332033 A  ERROR'
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:05:32 [DEBUG   ] spawn_process: at 2018-11-30 00:05:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:05:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:05:40 [DEBUG   ] Got command BAM from MCS: ref #671842
2018-11-30 00:05:40 [INFO    ] Finished processing BAM request
2018-11-30 00:05:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671842   8 58452   340033 A  ERROR'
2018-11-30 00:05:40 [DEBUG   ] Got command BAM from MCS: ref #671843
2018-11-30 00:05:40 [INFO    ] Finished processing BAM request
2018-11-30 00:05:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671843   8 58452   340037 A  ERROR'
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:05:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:05:40 [DEBUG   ] spawn_process: at 2018-11-30 00:05:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:05:48 [DEBUG   ] Got command BAM from MCS: ref #671844
2018-11-30 00:05:48 [INFO    ] Finished processing BAM request
2018-11-30 00:05:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671844   8 58452   348033 A  ERROR'
2018-11-30 00:05:48 [DEBUG   ] Got command BAM from MCS: ref #671845
2018-11-30 00:05:48 [INFO    ] Finished processing BAM request
2018-11-30 00:05:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671845   8 58452   348037 A  ERROR'
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:05:48 [DEBUG   ] spawn_process: at 2018-11-30 00:05:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:05:49 [DEBUG   ] Got command RPT from MCS: ref #671846
2018-11-30 00:05:49 [DEBUG   ] summary = ERROR
2018-11-30 00:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671846  13 58452   349845 A  ERRORERROR'
2018-11-30 00:05:49 [DEBUG   ] Got command RPT from MCS: ref #671847
2018-11-30 00:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671847  77 58452   349846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:05:56 [DEBUG   ] Got command BAM from MCS: ref #671863
2018-11-30 00:05:56 [INFO    ] Finished processing BAM request
2018-11-30 00:05:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671863   8 58452   356037 A  ERROR'
2018-11-30 00:05:56 [DEBUG   ] Got command BAM from MCS: ref #671864
2018-11-30 00:05:56 [INFO    ] Finished processing BAM request
2018-11-30 00:05:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:05:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671864   8 58452   356045 A  ERROR'
2018-11-30 00:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 00:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:05:56 [DEBUG   ] spawn_process: at 2018-11-30 00:05:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:05:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:05:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:05:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:05:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:05:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:05:57 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-11-30 00:05:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:06:04 [DEBUG   ] Got command BAM from MCS: ref #671865
2018-11-30 00:06:04 [INFO    ] Finished processing BAM request
2018-11-30 00:06:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671865   8 58452   364029 A  ERROR'
2018-11-30 00:06:04 [DEBUG   ] Got command BAM from MCS: ref #671866
2018-11-30 00:06:04 [INFO    ] Finished processing BAM request
2018-11-30 00:06:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671866   8 58452   364033 A  ERROR'
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:06:04 [DEBUG   ] spawn_process: at 2018-11-30 00:06:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:06:12 [DEBUG   ] Got command BAM from MCS: ref #671868
2018-11-30 00:06:12 [INFO    ] Finished processing BAM request
2018-11-30 00:06:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671868   8 58452   372029 A  ERROR'
2018-11-30 00:06:12 [DEBUG   ] Got command BAM from MCS: ref #671867
2018-11-30 00:06:12 [INFO    ] Finished processing BAM request
2018-11-30 00:06:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671867   8 58452   372033 A  ERROR'
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:06:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:06:12 [DEBUG   ] spawn_process: at 2018-11-30 00:06:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:06:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:06:20 [DEBUG   ] Got command BAM from MCS: ref #671869
2018-11-30 00:06:20 [INFO    ] Finished processing BAM request
2018-11-30 00:06:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671869   8 58452   380029 A  ERROR'
2018-11-30 00:06:20 [DEBUG   ] Got command BAM from MCS: ref #671870
2018-11-30 00:06:20 [INFO    ] Finished processing BAM request
2018-11-30 00:06:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671870   8 58452   380033 A  ERROR'
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:06:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:06:20 [DEBUG   ] spawn_process: at 2018-11-30 00:06:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:06:28 [DEBUG   ] Got command BAM from MCS: ref #671872
2018-11-30 00:06:28 [INFO    ] Finished processing BAM request
2018-11-30 00:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671872   8 58452   388029 A  ERROR'
2018-11-30 00:06:28 [DEBUG   ] Got command BAM from MCS: ref #671871
2018-11-30 00:06:28 [INFO    ] Finished processing BAM request
2018-11-30 00:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671871   8 58452   388033 A  ERROR'
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:06:28 [DEBUG   ] spawn_process: at 2018-11-30 00:06:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:06:36 [DEBUG   ] Got command BAM from MCS: ref #671873
2018-11-30 00:06:36 [INFO    ] Finished processing BAM request
2018-11-30 00:06:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671873   8 58452   396033 A  ERROR'
2018-11-30 00:06:36 [DEBUG   ] Got command BAM from MCS: ref #671874
2018-11-30 00:06:36 [INFO    ] Finished processing BAM request
2018-11-30 00:06:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671874   8 58452   396037 A  ERROR'
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:06:36 [DEBUG   ] spawn_process: at 2018-11-30 00:06:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:06:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:06:44 [DEBUG   ] Got command BAM from MCS: ref #671876
2018-11-30 00:06:44 [INFO    ] Finished processing BAM request
2018-11-30 00:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671876   8 58452   404029 A  ERROR'
2018-11-30 00:06:44 [DEBUG   ] Got command BAM from MCS: ref #671875
2018-11-30 00:06:44 [INFO    ] Finished processing BAM request
2018-11-30 00:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671875   8 58452   404033 A  ERROR'
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:06:44 [DEBUG   ] spawn_process: at 2018-11-30 00:06:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:06:52 [DEBUG   ] Got command BAM from MCS: ref #671877
2018-11-30 00:06:52 [INFO    ] Finished processing BAM request
2018-11-30 00:06:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671877   8 58452   412033 A  ERROR'
2018-11-30 00:06:52 [DEBUG   ] Got command BAM from MCS: ref #671878
2018-11-30 00:06:52 [INFO    ] Finished processing BAM request
2018-11-30 00:06:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671878   8 58452   412037 A  ERROR'
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:06:52 [DEBUG   ] spawn_process: at 2018-11-30 00:06:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-30 00:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:06:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:06:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:06:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:06:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:06:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:06:57 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-11-30 00:06:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:07:00 [DEBUG   ] Got command BAM from MCS: ref #671880
2018-11-30 00:07:00 [INFO    ] Finished processing BAM request
2018-11-30 00:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671880   8 58452   420025 A  ERROR'
2018-11-30 00:07:00 [DEBUG   ] Got command BAM from MCS: ref #671879
2018-11-30 00:07:00 [INFO    ] Finished processing BAM request
2018-11-30 00:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671879   8 58452   420029 A  ERROR'
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:07:00 [DEBUG   ] spawn_process: at 2018-11-30 00:07:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:07:08 [DEBUG   ] Got command BAM from MCS: ref #671882
2018-11-30 00:07:08 [INFO    ] Finished processing BAM request
2018-11-30 00:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671882   8 58452   428037 A  ERROR'
2018-11-30 00:07:08 [DEBUG   ] Got command BAM from MCS: ref #671881
2018-11-30 00:07:08 [INFO    ] Finished processing BAM request
2018-11-30 00:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671881   8 58452   428045 A  ERROR'
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:07:08 [DEBUG   ] spawn_process: at 2018-11-30 00:07:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:07:16 [DEBUG   ] Got command BAM from MCS: ref #671884
2018-11-30 00:07:16 [INFO    ] Finished processing BAM request
2018-11-30 00:07:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671884   8 58452   436025 A  ERROR'
2018-11-30 00:07:16 [DEBUG   ] Got command BAM from MCS: ref #671883
2018-11-30 00:07:16 [INFO    ] Finished processing BAM request
2018-11-30 00:07:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671883   8 58452   436029 A  ERROR'
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:07:16 [DEBUG   ] spawn_process: at 2018-11-30 00:07:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:07:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:07:25 [DEBUG   ] Got command BAM from MCS: ref #671886
2018-11-30 00:07:25 [INFO    ] Finished processing BAM request
2018-11-30 00:07:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671886   8 58452   445025 A  ERROR'
2018-11-30 00:07:25 [DEBUG   ] Got command BAM from MCS: ref #671885
2018-11-30 00:07:25 [INFO    ] Finished processing BAM request
2018-11-30 00:07:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671885   8 58452   445029 A  ERROR'
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:07:25 [DEBUG   ] spawn_process: at 2018-11-30 00:07:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:07:34 [DEBUG   ] Got command BAM from MCS: ref #671888
2018-11-30 00:07:34 [INFO    ] Finished processing BAM request
2018-11-30 00:07:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671888   8 58452   454029 A  ERROR'
2018-11-30 00:07:34 [DEBUG   ] Got command BAM from MCS: ref #671887
2018-11-30 00:07:34 [INFO    ] Finished processing BAM request
2018-11-30 00:07:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671887   8 58452   454033 A  ERROR'
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:07:34 [DEBUG   ] spawn_process: at 2018-11-30 00:07:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:07:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:07:43 [DEBUG   ] Got command BAM from MCS: ref #671889
2018-11-30 00:07:43 [INFO    ] Finished processing BAM request
2018-11-30 00:07:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671889   8 58452   463025 A  ERROR'
2018-11-30 00:07:43 [DEBUG   ] Got command BAM from MCS: ref #671890
2018-11-30 00:07:43 [INFO    ] Finished processing BAM request
2018-11-30 00:07:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671890   8 58452   463029 A  ERROR'
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:07:43 [DEBUG   ] spawn_process: at 2018-11-30 00:07:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:07:52 [DEBUG   ] Got command BAM from MCS: ref #671891
2018-11-30 00:07:52 [INFO    ] Finished processing BAM request
2018-11-30 00:07:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671891   8 58452   472033 A  ERROR'
2018-11-30 00:07:52 [DEBUG   ] Got command BAM from MCS: ref #671892
2018-11-30 00:07:52 [INFO    ] Finished processing BAM request
2018-11-30 00:07:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:07:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671892   8 58452   472037 A  ERROR'
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:07:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:07:52 [DEBUG   ] spawn_process: at 2018-11-30 00:07:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:07:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:07:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:07:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:07:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:07:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:07:58 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-11-30 00:07:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:08:01 [DEBUG   ] Got command BAM from MCS: ref #671894
2018-11-30 00:08:01 [INFO    ] Finished processing BAM request
2018-11-30 00:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671894   8 58452   481029 A  ERROR'
2018-11-30 00:08:01 [DEBUG   ] Got command BAM from MCS: ref #671893
2018-11-30 00:08:01 [INFO    ] Finished processing BAM request
2018-11-30 00:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671893   8 58452   481033 A  ERROR'
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:08:01 [DEBUG   ] spawn_process: at 2018-11-30 00:08:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:08:10 [DEBUG   ] Got command BAM from MCS: ref #671896
2018-11-30 00:08:10 [INFO    ] Finished processing BAM request
2018-11-30 00:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671896   8 58452   490025 A  ERROR'
2018-11-30 00:08:10 [DEBUG   ] Got command BAM from MCS: ref #671895
2018-11-30 00:08:10 [INFO    ] Finished processing BAM request
2018-11-30 00:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671895   8 58452   490029 A  ERROR'
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:08:10 [DEBUG   ] spawn_process: at 2018-11-30 00:08:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:08:19 [DEBUG   ] Got command BAM from MCS: ref #671901
2018-11-30 00:08:19 [INFO    ] Finished processing BAM request
2018-11-30 00:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671901   8 58452   499025 A  ERROR'
2018-11-30 00:08:19 [DEBUG   ] Got command BAM from MCS: ref #671902
2018-11-30 00:08:19 [INFO    ] Finished processing BAM request
2018-11-30 00:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671902   8 58452   499029 A  ERROR'
2018-11-30 00:08:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:08:19 [DEBUG   ] spawn_process: at 2018-11-30 00:08:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:08:28 [DEBUG   ] Got command BAM from MCS: ref #671904
2018-11-30 00:08:28 [INFO    ] Finished processing BAM request
2018-11-30 00:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671904   8 58452   508029 A  ERROR'
2018-11-30 00:08:28 [DEBUG   ] Got command BAM from MCS: ref #671903
2018-11-30 00:08:28 [INFO    ] Finished processing BAM request
2018-11-30 00:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671903   8 58452   508033 A  ERROR'
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:08:28 [DEBUG   ] spawn_process: at 2018-11-30 00:08:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:08:37 [DEBUG   ] Got command BAM from MCS: ref #671906
2018-11-30 00:08:37 [INFO    ] Finished processing BAM request
2018-11-30 00:08:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671906   8 58452   517033 A  ERROR'
2018-11-30 00:08:37 [DEBUG   ] Got command BAM from MCS: ref #671905
2018-11-30 00:08:37 [INFO    ] Finished processing BAM request
2018-11-30 00:08:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671905   8 58452   517037 A  ERROR'
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:08:37 [DEBUG   ] spawn_process: at 2018-11-30 00:08:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:08:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:08:46 [DEBUG   ] Got command BAM from MCS: ref #671908
2018-11-30 00:08:46 [INFO    ] Finished processing BAM request
2018-11-30 00:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671908   8 58452   526029 A  ERROR'
2018-11-30 00:08:46 [DEBUG   ] Got command BAM from MCS: ref #671907
2018-11-30 00:08:46 [INFO    ] Finished processing BAM request
2018-11-30 00:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671907   8 58452   526033 A  ERROR'
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:08:46 [DEBUG   ] spawn_process: at 2018-11-30 00:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:08:55 [DEBUG   ] Got command BAM from MCS: ref #671910
2018-11-30 00:08:55 [INFO    ] Finished processing BAM request
2018-11-30 00:08:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671910   8 58452   535025 A  ERROR'
2018-11-30 00:08:55 [DEBUG   ] Got command BAM from MCS: ref #671909
2018-11-30 00:08:55 [INFO    ] Finished processing BAM request
2018-11-30 00:08:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671909   8 58452   535029 A  ERROR'
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:08:55 [DEBUG   ] spawn_process: at 2018-11-30 00:08:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-30 00:08:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-30 00:08:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:08:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:08:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:08:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:08:58 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-11-30 00:08:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:09:04 [DEBUG   ] Got command BAM from MCS: ref #671912
2018-11-30 00:09:04 [INFO    ] Finished processing BAM request
2018-11-30 00:09:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671912   8 58452   544025 A  ERROR'
2018-11-30 00:09:04 [DEBUG   ] Got command BAM from MCS: ref #671911
2018-11-30 00:09:04 [INFO    ] Finished processing BAM request
2018-11-30 00:09:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671911   8 58452   544029 A  ERROR'
2018-11-30 00:09:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:09:04 [DEBUG   ] spawn_process: at 2018-11-30 00:09:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:09:05 [DEBUG   ] Got command RPT from MCS: ref #671913
2018-11-30 00:09:05 [DEBUG   ] summary = ERROR
2018-11-30 00:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671913  13 58452   545252 A  ERRORERROR'
2018-11-30 00:09:05 [DEBUG   ] Got command RPT from MCS: ref #671914
2018-11-30 00:09:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671914  77 58452   545253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:09:05 [DEBUG   ] spawn_process: at 2018-11-30 00:09:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:09:05 [DEBUG   ] Got command RPT from MCS: ref #671915
2018-11-30 00:09:05 [DEBUG   ] summary = ERROR
2018-11-30 00:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671915  13 58452   545443 A  ERRORERROR'
2018-11-30 00:09:05 [DEBUG   ] Got command RPT from MCS: ref #671916
2018-11-30 00:09:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671916  77 58452   545633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:09:05 [DEBUG   ] Got command RPT from MCS: ref #671917
2018-11-30 00:09:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671917  12 58452   545837 A  ERRORB£ff'
2018-11-30 00:09:13 [DEBUG   ] Got command BAM from MCS: ref #671919
2018-11-30 00:09:13 [INFO    ] Finished processing BAM request
2018-11-30 00:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671919   8 58452   553029 A  ERROR'
2018-11-30 00:09:13 [DEBUG   ] Got command BAM from MCS: ref #671918
2018-11-30 00:09:13 [INFO    ] Finished processing BAM request
2018-11-30 00:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671918   8 58452   553033 A  ERROR'
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:09:13 [DEBUG   ] spawn_process: at 2018-11-30 00:09:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:09:22 [DEBUG   ] Got command BAM from MCS: ref #671920
2018-11-30 00:09:22 [INFO    ] Finished processing BAM request
2018-11-30 00:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671920   8 58452   562033 A  ERROR'
2018-11-30 00:09:22 [DEBUG   ] Got command BAM from MCS: ref #671921
2018-11-30 00:09:22 [INFO    ] Finished processing BAM request
2018-11-30 00:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671921   8 58452   562037 A  ERROR'
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:09:22 [DEBUG   ] spawn_process: at 2018-11-30 00:09:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:09:31 [DEBUG   ] Got command BAM from MCS: ref #671923
2018-11-30 00:09:31 [INFO    ] Finished processing BAM request
2018-11-30 00:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671923   8 58452   571029 A  ERROR'
2018-11-30 00:09:31 [DEBUG   ] Got command BAM from MCS: ref #671922
2018-11-30 00:09:31 [INFO    ] Finished processing BAM request
2018-11-30 00:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671922   8 58452   571033 A  ERROR'
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:09:31 [DEBUG   ] spawn_process: at 2018-11-30 00:09:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:09:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:09:40 [DEBUG   ] Got command BAM from MCS: ref #671925
2018-11-30 00:09:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671925   8 58452   580029 A  ERROR'
2018-11-30 00:09:40 [DEBUG   ] Got command BAM from MCS: ref #671924
2018-11-30 00:09:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671924   8 58452   580033 A  ERROR'
2018-11-30 00:09:40 [INFO    ] Finished processing BAM request
2018-11-30 00:09:40 [INFO    ] Finished processing BAM request
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:09:40 [DEBUG   ] spawn_process: at 2018-11-30 00:09:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:09:49 [DEBUG   ] Got command BAM from MCS: ref #671926
2018-11-30 00:09:49 [INFO    ] Finished processing BAM request
2018-11-30 00:09:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671926   8 58452   589025 A  ERROR'
2018-11-30 00:09:49 [DEBUG   ] Got command BAM from MCS: ref #671927
2018-11-30 00:09:49 [INFO    ] Finished processing BAM request
2018-11-30 00:09:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671927   8 58452   589029 A  ERROR'
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:09:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:09:49 [DEBUG   ] spawn_process: at 2018-11-30 00:09:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 00:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:09:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:09:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:09:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:09:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:09:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:09:57 [DEBUG   ] Finished updating board flags in 1.144 seconds
2018-11-30 00:09:58 [DEBUG   ] Got command BAM from MCS: ref #671929
2018-11-30 00:09:58 [INFO    ] Finished processing BAM request
2018-11-30 00:09:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671929   8 58452   598029 A  ERROR'
2018-11-30 00:09:58 [DEBUG   ] Got command BAM from MCS: ref #671928
2018-11-30 00:09:58 [INFO    ] Finished processing BAM request
2018-11-30 00:09:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671928   8 58452   598033 A  ERROR'
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:09:58 [DEBUG   ] spawn_process: at 2018-11-30 00:09:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:09:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:10:07 [DEBUG   ] Got command BAM from MCS: ref #671930
2018-11-30 00:10:07 [INFO    ] Finished processing BAM request
2018-11-30 00:10:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671930   8 58452   607029 A  ERROR'
2018-11-30 00:10:07 [DEBUG   ] Got command BAM from MCS: ref #671931
2018-11-30 00:10:07 [INFO    ] Finished processing BAM request
2018-11-30 00:10:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671931   8 58452   607033 A  ERROR'
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:10:07 [DEBUG   ] spawn_process: at 2018-11-30 00:10:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:10:16 [DEBUG   ] Got command BAM from MCS: ref #671933
2018-11-30 00:10:16 [INFO    ] Finished processing BAM request
2018-11-30 00:10:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671933   8 58452   616025 A  ERROR'
2018-11-30 00:10:16 [DEBUG   ] Got command BAM from MCS: ref #671932
2018-11-30 00:10:16 [INFO    ] Finished processing BAM request
2018-11-30 00:10:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671932   8 58452   616029 A  ERROR'
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:10:16 [DEBUG   ] spawn_process: at 2018-11-30 00:10:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:10:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:10:25 [DEBUG   ] Got command BAM from MCS: ref #671935
2018-11-30 00:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671935   8 58452   625170 A  ERROR'
2018-11-30 00:10:25 [DEBUG   ] Got command BAM from MCS: ref #671934
2018-11-30 00:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671934   8 58452   625174 A  ERROR'
2018-11-30 00:10:25 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-30 00:10:25 [INFO    ] Finished processing BAM request
2018-11-30 00:10:25 [INFO    ] Finished processing BAM request
2018-11-30 00:10:25 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-30 00:10:25 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-30 00:10:25 [DEBUG   ] 
2018-11-30 00:10:34 [DEBUG   ] Got command BAM from MCS: ref #671936
2018-11-30 00:10:34 [INFO    ] Finished processing BAM request
2018-11-30 00:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671936   8 58452   634034 A  ERROR'
2018-11-30 00:10:34 [DEBUG   ] Got command BAM from MCS: ref #671937
2018-11-30 00:10:34 [INFO    ] Finished processing BAM request
2018-11-30 00:10:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671937   8 58452   634038 A  ERROR'
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:10:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:10:34 [DEBUG   ] spawn_process: at 2018-11-30 00:10:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:10:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 00:10:43 [DEBUG   ] Got command BAM from MCS: ref #671938
2018-11-30 00:10:43 [INFO    ] Finished processing BAM request
2018-11-30 00:10:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671938   8 58452   643030 A  ERROR'
2018-11-30 00:10:43 [DEBUG   ] Got command BAM from MCS: ref #671939
2018-11-30 00:10:43 [INFO    ] Finished processing BAM request
2018-11-30 00:10:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671939   8 58452   643034 A  ERROR'
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:10:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:10:43 [DEBUG   ] spawn_process: at 2018-11-30 00:10:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:10:49 [DEBUG   ] Got command RPT from MCS: ref #671940
2018-11-30 00:10:49 [DEBUG   ] summary = ERROR
2018-11-30 00:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671940  13 58452   649838 A  ERRORERROR'
2018-11-30 00:10:49 [DEBUG   ] Got command RPT from MCS: ref #671941
2018-11-30 00:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671941  77 58452   649838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:10:52 [DEBUG   ] Got command BAM from MCS: ref #671958
2018-11-30 00:10:52 [INFO    ] Finished processing BAM request
2018-11-30 00:10:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671958   8 58452   652026 A  ERROR'
2018-11-30 00:10:52 [DEBUG   ] Got command BAM from MCS: ref #671957
2018-11-30 00:10:52 [INFO    ] Finished processing BAM request
2018-11-30 00:10:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:10:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671957   8 58452   652030 A  ERROR'
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:10:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:10:52 [DEBUG   ] spawn_process: at 2018-11-30 00:10:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:10:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:10:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:10:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:10:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:10:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:10:57 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-30 00:10:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:11:01 [DEBUG   ] Got command BAM from MCS: ref #671959
2018-11-30 00:11:01 [INFO    ] Finished processing BAM request
2018-11-30 00:11:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671959   8 58452   661034 A  ERROR'
2018-11-30 00:11:01 [DEBUG   ] Got command BAM from MCS: ref #671960
2018-11-30 00:11:01 [INFO    ] Finished processing BAM request
2018-11-30 00:11:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671960   8 58452   661038 A  ERROR'
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:11:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:11:01 [DEBUG   ] spawn_process: at 2018-11-30 00:11:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:11:11 [DEBUG   ] Got command BAM from MCS: ref #671961
2018-11-30 00:11:11 [INFO    ] Finished processing BAM request
2018-11-30 00:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671961   8 58452   671026 A  ERROR'
2018-11-30 00:11:11 [DEBUG   ] Got command BAM from MCS: ref #671962
2018-11-30 00:11:11 [INFO    ] Finished processing BAM request
2018-11-30 00:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671962   8 58452   671030 A  ERROR'
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:11:11 [DEBUG   ] spawn_process: at 2018-11-30 00:11:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:11:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:11:21 [DEBUG   ] Got command BAM from MCS: ref #671967
2018-11-30 00:11:21 [INFO    ] Finished processing BAM request
2018-11-30 00:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671967   8 58452   681030 A  ERROR'
2018-11-30 00:11:21 [DEBUG   ] Got command BAM from MCS: ref #671968
2018-11-30 00:11:21 [INFO    ] Finished processing BAM request
2018-11-30 00:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671968   8 58452   681034 A  ERROR'
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:11:21 [DEBUG   ] spawn_process: at 2018-11-30 00:11:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:11:31 [DEBUG   ] Got command BAM from MCS: ref #671970
2018-11-30 00:11:31 [INFO    ] Finished processing BAM request
2018-11-30 00:11:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671970   8 58452   691034 A  ERROR'
2018-11-30 00:11:31 [DEBUG   ] Got command BAM from MCS: ref #671969
2018-11-30 00:11:31 [INFO    ] Finished processing BAM request
2018-11-30 00:11:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671969   8 58452   691038 A  ERROR'
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:11:31 [DEBUG   ] spawn_process: at 2018-11-30 00:11:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:11:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:11:41 [DEBUG   ] Got command BAM from MCS: ref #671971
2018-11-30 00:11:41 [INFO    ] Finished processing BAM request
2018-11-30 00:11:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671971   8 58452   701026 A  ERROR'
2018-11-30 00:11:41 [DEBUG   ] Got command BAM from MCS: ref #671972
2018-11-30 00:11:41 [INFO    ] Finished processing BAM request
2018-11-30 00:11:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671972   8 58452   701030 A  ERROR'
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:11:41 [DEBUG   ] spawn_process: at 2018-11-30 00:11:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:11:51 [DEBUG   ] Got command BAM from MCS: ref #671974
2018-11-30 00:11:51 [INFO    ] Finished processing BAM request
2018-11-30 00:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671974   8 58452   711030 A  ERROR'
2018-11-30 00:11:51 [DEBUG   ] Got command BAM from MCS: ref #671973
2018-11-30 00:11:51 [INFO    ] Finished processing BAM request
2018-11-30 00:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671973   8 58452   711034 A  ERROR'
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:11:51 [DEBUG   ] spawn_process: at 2018-11-30 00:11:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-30 00:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:11:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-30 00:11:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:11:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:11:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:11:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:11:57 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-30 00:11:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:12:01 [DEBUG   ] Got command BAM from MCS: ref #671976
2018-11-30 00:12:01 [INFO    ] Finished processing BAM request
2018-11-30 00:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671976   8 58452   721034 A  ERROR'
2018-11-30 00:12:01 [DEBUG   ] Got command BAM from MCS: ref #671975
2018-11-30 00:12:01 [INFO    ] Finished processing BAM request
2018-11-30 00:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671975   8 58452   721038 A  ERROR'
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:12:01 [DEBUG   ] spawn_process: at 2018-11-30 00:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:12:11 [DEBUG   ] Got command BAM from MCS: ref #671977
2018-11-30 00:12:11 [INFO    ] Finished processing BAM request
2018-11-30 00:12:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671977   8 58452   731026 A  ERROR'
2018-11-30 00:12:11 [DEBUG   ] Got command BAM from MCS: ref #671978
2018-11-30 00:12:11 [INFO    ] Finished processing BAM request
2018-11-30 00:12:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671978   8 58452   731030 A  ERROR'
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:12:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:12:11 [DEBUG   ] spawn_process: at 2018-11-30 00:12:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:12:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:12:21 [DEBUG   ] Got command BAM from MCS: ref #671979
2018-11-30 00:12:21 [INFO    ] Finished processing BAM request
2018-11-30 00:12:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671979   8 58452   741030 A  ERROR'
2018-11-30 00:12:21 [DEBUG   ] Got command BAM from MCS: ref #671980
2018-11-30 00:12:21 [INFO    ] Finished processing BAM request
2018-11-30 00:12:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671980   8 58452   741034 A  ERROR'
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:12:21 [DEBUG   ] spawn_process: at 2018-11-30 00:12:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:12:31 [DEBUG   ] Got command BAM from MCS: ref #671981
2018-11-30 00:12:31 [INFO    ] Finished processing BAM request
2018-11-30 00:12:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671981   8 58452   751034 A  ERROR'
2018-11-30 00:12:31 [DEBUG   ] Got command BAM from MCS: ref #671982
2018-11-30 00:12:31 [INFO    ] Finished processing BAM request
2018-11-30 00:12:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671982   8 58452   751038 A  ERROR'
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:12:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:12:31 [DEBUG   ] spawn_process: at 2018-11-30 00:12:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:12:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:12:41 [DEBUG   ] Got command BAM from MCS: ref #671983
2018-11-30 00:12:41 [INFO    ] Finished processing BAM request
2018-11-30 00:12:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671983   8 58452   761026 A  ERROR'
2018-11-30 00:12:41 [DEBUG   ] Got command BAM from MCS: ref #671984
2018-11-30 00:12:41 [INFO    ] Finished processing BAM request
2018-11-30 00:12:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671984   8 58452   761030 A  ERROR'
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:12:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:12:41 [DEBUG   ] spawn_process: at 2018-11-30 00:12:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:12:51 [DEBUG   ] Got command BAM from MCS: ref #671986
2018-11-30 00:12:51 [INFO    ] Finished processing BAM request
2018-11-30 00:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671986   8 58452   771030 A  ERROR'
2018-11-30 00:12:51 [DEBUG   ] Got command BAM from MCS: ref #671985
2018-11-30 00:12:51 [INFO    ] Finished processing BAM request
2018-11-30 00:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671985   8 58452   771034 A  ERROR'
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:12:51 [DEBUG   ] spawn_process: at 2018-11-30 00:12:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-30 00:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 00:12:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-30 00:12:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:12:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:12:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:12:57 [WARNING ] (13, 1, 'bot')
2018-11-30 00:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:12:57 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-11-30 00:12:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:13:01 [DEBUG   ] Got command BAM from MCS: ref #671987
2018-11-30 00:13:01 [INFO    ] Finished processing BAM request
2018-11-30 00:13:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671987   8 58452   781033 A  ERROR'
2018-11-30 00:13:01 [DEBUG   ] Got command BAM from MCS: ref #671988
2018-11-30 00:13:01 [INFO    ] Finished processing BAM request
2018-11-30 00:13:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671988   8 58452   781037 A  ERROR'
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:13:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:13:01 [DEBUG   ] spawn_process: at 2018-11-30 00:13:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:13:11 [DEBUG   ] Got command BAM from MCS: ref #671989
2018-11-30 00:13:11 [INFO    ] Finished processing BAM request
2018-11-30 00:13:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671989   8 58452   791041 A  ERROR'
2018-11-30 00:13:11 [DEBUG   ] Got command BAM from MCS: ref #671990
2018-11-30 00:13:11 [INFO    ] Finished processing BAM request
2018-11-30 00:13:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671990   8 58452   791045 A  ERROR'
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:13:11 [DEBUG   ] spawn_process: at 2018-11-30 00:13:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:13:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:13:21 [DEBUG   ] Got command BAM from MCS: ref #671992
2018-11-30 00:13:21 [INFO    ] Finished processing BAM request
2018-11-30 00:13:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671992   8 58452   801033 A  ERROR'
2018-11-30 00:13:21 [DEBUG   ] Got command BAM from MCS: ref #671991
2018-11-30 00:13:21 [INFO    ] Finished processing BAM request
2018-11-30 00:13:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671991   8 58452   801037 A  ERROR'
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:13:21 [DEBUG   ] spawn_process: at 2018-11-30 00:13:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:13:31 [DEBUG   ] Got command BAM from MCS: ref #671994
2018-11-30 00:13:31 [INFO    ] Finished processing BAM request
2018-11-30 00:13:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671994   8 58452   811029 A  ERROR'
2018-11-30 00:13:31 [DEBUG   ] Got command BAM from MCS: ref #671993
2018-11-30 00:13:31 [INFO    ] Finished processing BAM request
2018-11-30 00:13:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671993   8 58452   811033 A  ERROR'
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:13:31 [DEBUG   ] spawn_process: at 2018-11-30 00:13:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:13:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:13:41 [DEBUG   ] Got command BAM from MCS: ref #671996
2018-11-30 00:13:41 [INFO    ] Finished processing BAM request
2018-11-30 00:13:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671996   8 58452   821033 A  ERROR'
2018-11-30 00:13:41 [DEBUG   ] Got command BAM from MCS: ref #671995
2018-11-30 00:13:41 [INFO    ] Finished processing BAM request
2018-11-30 00:13:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671995   8 58452   821037 A  ERROR'
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:13:41 [DEBUG   ] spawn_process: at 2018-11-30 00:13:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:13:51 [DEBUG   ] Got command BAM from MCS: ref #671999
2018-11-30 00:13:51 [INFO    ] Finished processing BAM request
2018-11-30 00:13:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671999   8 58452   831029 A  ERROR'
2018-11-30 00:13:51 [DEBUG   ] Got command BAM from MCS: ref #672000
2018-11-30 00:13:51 [INFO    ] Finished processing BAM request
2018-11-30 00:13:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672000   8 58452   831033 A  ERROR'
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:13:51 [DEBUG   ] spawn_process: at 2018-11-30 00:13:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 00:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 00:13:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:13:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:13:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:13:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:13:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:13:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:13:58 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-30 00:13:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 00:14:01 [DEBUG   ] Got command BAM from MCS: ref #672001
2018-11-30 00:14:01 [INFO    ] Finished processing BAM request
2018-11-30 00:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672001   8 58452   841029 A  ERROR'
2018-11-30 00:14:01 [DEBUG   ] Got command BAM from MCS: ref #672002
2018-11-30 00:14:01 [INFO    ] Finished processing BAM request
2018-11-30 00:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672002   8 58452   841033 A  ERROR'
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:14:01 [DEBUG   ] spawn_process: at 2018-11-30 00:14:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:14:05 [DEBUG   ] Got command RPT from MCS: ref #672003
2018-11-30 00:14:05 [DEBUG   ] summary = ERROR
2018-11-30 00:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672003  13 58452   845125 A  ERRORERROR'
2018-11-30 00:14:05 [DEBUG   ] Got command RPT from MCS: ref #672004
2018-11-30 00:14:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672004  77 58452   845317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:14:05 [DEBUG   ] Got command RPT from MCS: ref #672005
2018-11-30 00:14:05 [DEBUG   ] summary = ERROR
2018-11-30 00:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672005  13 58452   845521 A  ERRORERROR'
2018-11-30 00:14:05 [DEBUG   ] Got command RPT from MCS: ref #672007
2018-11-30 00:14:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672007  77 58452   845725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:14:05 [DEBUG   ] Got command RPT from MCS: ref #672008
2018-11-30 00:14:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672008  12 58452   845917 A  ERRORB£ff'
2018-11-30 00:14:11 [DEBUG   ] Got command BAM from MCS: ref #672014
2018-11-30 00:14:11 [INFO    ] Finished processing BAM request
2018-11-30 00:14:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672014   8 58452   851033 A  ERROR'
2018-11-30 00:14:11 [DEBUG   ] Got command BAM from MCS: ref #672013
2018-11-30 00:14:11 [INFO    ] Finished processing BAM request
2018-11-30 00:14:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672013   8 58452   851037 A  ERROR'
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:14:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:14:11 [DEBUG   ] spawn_process: at 2018-11-30 00:14:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:14:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 00:14:22 [DEBUG   ] Got command BAM from MCS: ref #672019
2018-11-30 00:14:22 [INFO    ] Finished processing BAM request
2018-11-30 00:14:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672019   8 58452   862029 A  ERROR'
2018-11-30 00:14:22 [DEBUG   ] Got command BAM from MCS: ref #672020
2018-11-30 00:14:22 [INFO    ] Finished processing BAM request
2018-11-30 00:14:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672020   8 58452   862033 A  ERROR'
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:14:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:14:22 [DEBUG   ] spawn_process: at 2018-11-30 00:14:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:14:33 [DEBUG   ] Got command BAM from MCS: ref #672021
2018-11-30 00:14:33 [INFO    ] Finished processing BAM request
2018-11-30 00:14:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672021   8 58452   873029 A  ERROR'
2018-11-30 00:14:33 [DEBUG   ] Got command BAM from MCS: ref #672022
2018-11-30 00:14:33 [INFO    ] Finished processing BAM request
2018-11-30 00:14:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672022   8 58452   873033 A  ERROR'
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:14:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:14:33 [DEBUG   ] spawn_process: at 2018-11-30 00:14:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:14:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:14:44 [DEBUG   ] Got command BAM from MCS: ref #672024
2018-11-30 00:14:44 [INFO    ] Finished processing BAM request
2018-11-30 00:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672024   8 58452   884033 A  ERROR'
2018-11-30 00:14:44 [DEBUG   ] Got command BAM from MCS: ref #672023
2018-11-30 00:14:44 [INFO    ] Finished processing BAM request
2018-11-30 00:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672023   8 58452   884037 A  ERROR'
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:14:44 [DEBUG   ] spawn_process: at 2018-11-30 00:14:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:14:55 [DEBUG   ] Got command BAM from MCS: ref #672025
2018-11-30 00:14:55 [INFO    ] Finished processing BAM request
2018-11-30 00:14:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672025   8 58452   895033 A  ERROR'
2018-11-30 00:14:55 [DEBUG   ] Got command BAM from MCS: ref #672026
2018-11-30 00:14:55 [INFO    ] Finished processing BAM request
2018-11-30 00:14:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672026   8 58452   895037 A  ERROR'
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:14:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:14:55 [DEBUG   ] spawn_process: at 2018-11-30 00:14:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-30 00:14:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:14:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:14:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:14:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:14:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:14:58 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-30 00:14:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:15:06 [DEBUG   ] Got command BAM from MCS: ref #672027
2018-11-30 00:15:06 [INFO    ] Finished processing BAM request
2018-11-30 00:15:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672027   8 58452   906029 A  ERROR'
2018-11-30 00:15:06 [DEBUG   ] Got command BAM from MCS: ref #672028
2018-11-30 00:15:06 [INFO    ] Finished processing BAM request
2018-11-30 00:15:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672028   8 58452   906033 A  ERROR'
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:15:06 [DEBUG   ] spawn_process: at 2018-11-30 00:15:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:15:17 [DEBUG   ] Got command BAM from MCS: ref #672029
2018-11-30 00:15:17 [INFO    ] Finished processing BAM request
2018-11-30 00:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672029   8 58452   917025 A  ERROR'
2018-11-30 00:15:17 [DEBUG   ] Got command BAM from MCS: ref #672030
2018-11-30 00:15:17 [INFO    ] Finished processing BAM request
2018-11-30 00:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672030   8 58452   917029 A  ERROR'
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:15:17 [DEBUG   ] spawn_process: at 2018-11-30 00:15:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:15:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:15:28 [DEBUG   ] Got command BAM from MCS: ref #672031
2018-11-30 00:15:28 [INFO    ] Finished processing BAM request
2018-11-30 00:15:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672031   8 58452   928033 A  ERROR'
2018-11-30 00:15:28 [DEBUG   ] Got command BAM from MCS: ref #672032
2018-11-30 00:15:28 [INFO    ] Finished processing BAM request
2018-11-30 00:15:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672032   8 58452   928037 A  ERROR'
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:15:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:15:28 [DEBUG   ] spawn_process: at 2018-11-30 00:15:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:15:39 [DEBUG   ] Got command BAM from MCS: ref #672033
2018-11-30 00:15:39 [INFO    ] Finished processing BAM request
2018-11-30 00:15:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672033   8 58452   939034 A  ERROR'
2018-11-30 00:15:39 [DEBUG   ] Got command BAM from MCS: ref #672034
2018-11-30 00:15:39 [INFO    ] Finished processing BAM request
2018-11-30 00:15:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672034   8 58452   939038 A  ERROR'
2018-11-30 00:15:39 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:15:40 [DEBUG   ] spawn_process: at 2018-11-30 00:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:15:49 [DEBUG   ] Got command RPT from MCS: ref #672037
2018-11-30 00:15:49 [DEBUG   ] summary = ERROR
2018-11-30 00:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672037  13 58452   949838 A  ERRORERROR'
2018-11-30 00:15:49 [DEBUG   ] Got command RPT from MCS: ref #672038
2018-11-30 00:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672038  77 58452   949838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:15:50 [DEBUG   ] Got command BAM from MCS: ref #672036
2018-11-30 00:15:50 [INFO    ] Finished processing BAM request
2018-11-30 00:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672036   8 58452   950034 A  ERROR'
2018-11-30 00:15:50 [DEBUG   ] Got command BAM from MCS: ref #672035
2018-11-30 00:15:50 [INFO    ] Finished processing BAM request
2018-11-30 00:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672035   8 58452   950038 A  ERROR'
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:15:50 [DEBUG   ] spawn_process: at 2018-11-30 00:15:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:15:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-30 00:15:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:15:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:15:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:15:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:15:58 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-30 00:16:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:16:01 [DEBUG   ] Got command BAM from MCS: ref #672054
2018-11-30 00:16:01 [INFO    ] Finished processing BAM request
2018-11-30 00:16:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672054   8 58452   961033 A  ERROR'
2018-11-30 00:16:01 [DEBUG   ] Got command BAM from MCS: ref #672055
2018-11-30 00:16:01 [INFO    ] Finished processing BAM request
2018-11-30 00:16:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672055   8 58452   961037 A  ERROR'
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:16:01 [DEBUG   ] spawn_process: at 2018-11-30 00:16:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:16:12 [DEBUG   ] Got command BAM from MCS: ref #672056
2018-11-30 00:16:12 [INFO    ] Finished processing BAM request
2018-11-30 00:16:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672056   8 58452   972025 A  ERROR'
2018-11-30 00:16:12 [DEBUG   ] Got command BAM from MCS: ref #672057
2018-11-30 00:16:12 [INFO    ] Finished processing BAM request
2018-11-30 00:16:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672057   8 58452   972029 A  ERROR'
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:16:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:16:12 [DEBUG   ] spawn_process: at 2018-11-30 00:16:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:16:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:16:23 [DEBUG   ] Got command BAM from MCS: ref #672058
2018-11-30 00:16:23 [INFO    ] Finished processing BAM request
2018-11-30 00:16:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672058   8 58452   983025 A  ERROR'
2018-11-30 00:16:23 [DEBUG   ] Got command BAM from MCS: ref #672059
2018-11-30 00:16:23 [INFO    ] Finished processing BAM request
2018-11-30 00:16:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672059   8 58452   983029 A  ERROR'
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:16:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:16:23 [DEBUG   ] spawn_process: at 2018-11-30 00:16:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:16:34 [DEBUG   ] Got command BAM from MCS: ref #672061
2018-11-30 00:16:34 [INFO    ] Finished processing BAM request
2018-11-30 00:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672061   8 58452   994025 A  ERROR'
2018-11-30 00:16:34 [DEBUG   ] Got command BAM from MCS: ref #672060
2018-11-30 00:16:34 [INFO    ] Finished processing BAM request
2018-11-30 00:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672060   8 58452   994029 A  ERROR'
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:16:34 [DEBUG   ] spawn_process: at 2018-11-30 00:16:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:16:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:16:45 [DEBUG   ] Got command BAM from MCS: ref #672063
2018-11-30 00:16:45 [INFO    ] Finished processing BAM request
2018-11-30 00:16:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672063   8 58452  1005029 A  ERROR'
2018-11-30 00:16:45 [DEBUG   ] Got command BAM from MCS: ref #672062
2018-11-30 00:16:45 [INFO    ] Finished processing BAM request
2018-11-30 00:16:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672062   8 58452  1005033 A  ERROR'
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:16:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:16:45 [DEBUG   ] spawn_process: at 2018-11-30 00:16:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:16:56 [DEBUG   ] Got command BAM from MCS: ref #672065
2018-11-30 00:16:56 [INFO    ] Finished processing BAM request
2018-11-30 00:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672065   8 58452  1016037 A  ERROR'
2018-11-30 00:16:56 [DEBUG   ] Got command BAM from MCS: ref #672064
2018-11-30 00:16:56 [INFO    ] Finished processing BAM request
2018-11-30 00:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672064   8 58452  1016041 A  ERROR'
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:16:56 [DEBUG   ] spawn_process: at 2018-11-30 00:16:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-30 00:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:16:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:16:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-30 00:16:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:16:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:16:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:16:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:16:58 [DEBUG   ] Finished updating board flags in 1.288 seconds
2018-11-30 00:17:00 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 00:17:07 [DEBUG   ] Got command BAM from MCS: ref #672067
2018-11-30 00:17:07 [INFO    ] Finished processing BAM request
2018-11-30 00:17:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672067   8 58452  1027025 A  ERROR'
2018-11-30 00:17:07 [DEBUG   ] Got command BAM from MCS: ref #672066
2018-11-30 00:17:07 [INFO    ] Finished processing BAM request
2018-11-30 00:17:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672066   8 58452  1027029 A  ERROR'
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:17:07 [DEBUG   ] spawn_process: at 2018-11-30 00:17:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:17:19 [DEBUG   ] Got command BAM from MCS: ref #672072
2018-11-30 00:17:19 [INFO    ] Finished processing BAM request
2018-11-30 00:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672072   8 58452  1039033 A  ERROR'
2018-11-30 00:17:19 [DEBUG   ] Got command BAM from MCS: ref #672073
2018-11-30 00:17:19 [INFO    ] Finished processing BAM request
2018-11-30 00:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672073   8 58452  1039037 A  ERROR'
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:17:19 [DEBUG   ] spawn_process: at 2018-11-30 00:17:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:17:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:17:31 [DEBUG   ] Got command BAM from MCS: ref #672074
2018-11-30 00:17:31 [INFO    ] Finished processing BAM request
2018-11-30 00:17:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672074   8 58452  1051057 A  ERROR'
2018-11-30 00:17:31 [DEBUG   ] Got command BAM from MCS: ref #672075
2018-11-30 00:17:31 [INFO    ] Finished processing BAM request
2018-11-30 00:17:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672075   8 58452  1051061 A  ERROR'
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:17:31 [DEBUG   ] spawn_process: at 2018-11-30 00:17:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:17:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:17:43 [DEBUG   ] Got command BAM from MCS: ref #672077
2018-11-30 00:17:43 [INFO    ] Finished processing BAM request
2018-11-30 00:17:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672077   8 58452  1063029 A  ERROR'
2018-11-30 00:17:43 [DEBUG   ] Got command BAM from MCS: ref #672076
2018-11-30 00:17:43 [INFO    ] Finished processing BAM request
2018-11-30 00:17:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672076   8 58452  1063033 A  ERROR'
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:17:43 [DEBUG   ] spawn_process: at 2018-11-30 00:17:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:17:55 [DEBUG   ] Got command BAM from MCS: ref #672078
2018-11-30 00:17:55 [INFO    ] Finished processing BAM request
2018-11-30 00:17:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672078   8 58452  1075025 A  ERROR'
2018-11-30 00:17:55 [DEBUG   ] Got command BAM from MCS: ref #672079
2018-11-30 00:17:55 [INFO    ] Finished processing BAM request
2018-11-30 00:17:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:17:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672079   8 58452  1075029 A  ERROR'
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 00:17:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 00:17:55 [DEBUG   ] spawn_process: at 2018-11-30 00:17:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 00:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-30 00:17:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:17:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-30 00:17:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:17:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:17:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:17:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:17:58 [DEBUG   ] Finished updating board flags in 1.155 seconds
2018-11-30 00:18:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:18:07 [DEBUG   ] Got command BAM from MCS: ref #672080
2018-11-30 00:18:07 [INFO    ] Finished processing BAM request
2018-11-30 00:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672080   8 58452  1087025 A  ERROR'
2018-11-30 00:18:07 [DEBUG   ] Got command BAM from MCS: ref #672081
2018-11-30 00:18:07 [INFO    ] Finished processing BAM request
2018-11-30 00:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672081   8 58452  1087029 A  ERROR'
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:18:07 [DEBUG   ] spawn_process: at 2018-11-30 00:18:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:18:19 [DEBUG   ] Got command BAM from MCS: ref #672082
2018-11-30 00:18:19 [INFO    ] Finished processing BAM request
2018-11-30 00:18:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672082   8 58452  1099033 A  ERROR'
2018-11-30 00:18:19 [DEBUG   ] Got command BAM from MCS: ref #672083
2018-11-30 00:18:19 [INFO    ] Finished processing BAM request
2018-11-30 00:18:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672083   8 58452  1099037 A  ERROR'
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:18:19 [DEBUG   ] spawn_process: at 2018-11-30 00:18:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:18:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 00:18:31 [DEBUG   ] Got command BAM from MCS: ref #672084
2018-11-30 00:18:31 [INFO    ] Finished processing BAM request
2018-11-30 00:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672084   8 58452  1111033 A  ERROR'
2018-11-30 00:18:31 [DEBUG   ] Got command BAM from MCS: ref #672085
2018-11-30 00:18:31 [INFO    ] Finished processing BAM request
2018-11-30 00:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672085   8 58452  1111037 A  ERROR'
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 00:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 00:18:31 [DEBUG   ] spawn_process: at 2018-11-30 00:18:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 00:18:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:18:43 [DEBUG   ] Got command BAM from MCS: ref #672086
2018-11-30 00:18:43 [INFO    ] Finished processing BAM request
2018-11-30 00:18:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672086   8 58452  1123029 A  ERROR'
2018-11-30 00:18:43 [DEBUG   ] Got command BAM from MCS: ref #672087
2018-11-30 00:18:43 [INFO    ] Finished processing BAM request
2018-11-30 00:18:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672087   8 58452  1123033 A  ERROR'
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:18:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:18:43 [DEBUG   ] spawn_process: at 2018-11-30 00:18:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:18:55 [DEBUG   ] Got command BAM from MCS: ref #672089
2018-11-30 00:18:55 [INFO    ] Finished processing BAM request
2018-11-30 00:18:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672089   8 58452  1135029 A  ERROR'
2018-11-30 00:18:55 [DEBUG   ] Got command BAM from MCS: ref #672088
2018-11-30 00:18:55 [INFO    ] Finished processing BAM request
2018-11-30 00:18:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:18:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672088   8 58452  1135033 A  ERROR'
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 00:18:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 00:18:55 [DEBUG   ] spawn_process: at 2018-11-30 00:18:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 00:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 00:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:18:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:18:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-30 00:18:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:18:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:18:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:18:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:18:58 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-11-30 00:19:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:19:05 [DEBUG   ] Got command RPT from MCS: ref #672090
2018-11-30 00:19:05 [DEBUG   ] summary = ERROR
2018-11-30 00:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672090  13 58452  1145209 A  ERRORERROR'
2018-11-30 00:19:05 [DEBUG   ] Got command RPT from MCS: ref #672091
2018-11-30 00:19:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672091  77 58452  1145401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:19:05 [DEBUG   ] Got command RPT from MCS: ref #672092
2018-11-30 00:19:05 [DEBUG   ] summary = ERROR
2018-11-30 00:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672092  13 58452  1145605 A  ERRORERROR'
2018-11-30 00:19:05 [DEBUG   ] Got command RPT from MCS: ref #672093
2018-11-30 00:19:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672093  77 58452  1145809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:19:06 [DEBUG   ] Got command RPT from MCS: ref #672094
2018-11-30 00:19:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672094  12 58452  1146001 A  ERRORB¤ff'
2018-11-30 00:19:07 [DEBUG   ] Got command BAM from MCS: ref #672095
2018-11-30 00:19:07 [INFO    ] Finished processing BAM request
2018-11-30 00:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672095   8 58452  1147025 A  ERROR'
2018-11-30 00:19:07 [DEBUG   ] Got command BAM from MCS: ref #672096
2018-11-30 00:19:07 [INFO    ] Finished processing BAM request
2018-11-30 00:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 00:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672096   8 58452  1147029 A  ERROR'
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 00:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 00:19:07 [DEBUG   ] spawn_process: at 2018-11-30 00:19:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 00:19:16 [DEBUG   ] Got command STP from MCS: ref #672098
2018-11-30 00:19:16 [INFO    ] Finished processing BAM request
2018-11-30 00:19:16 [INFO    ] Shutdown the adder chain on beam #2
2018-11-30 00:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   672098   8 58452  1156117 A  ERROR'
2018-11-30 00:19:16 [DEBUG   ] Got command STP from MCS: ref #672097
2018-11-30 00:19:16 [INFO    ] Finished processing BAM request
2018-11-30 00:19:16 [INFO    ] Shutdown the adder chain on beam #3
2018-11-30 00:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   672097   8 58452  1156121 A  ERROR'
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 00:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 00:19:16 [DEBUG   ] spawn_process: at 2018-11-30 00:19:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 00:19:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:19:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 00:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:19:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-30 00:19:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:19:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:19:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:19:58 [WARNING ] (13, 1, 'bot')
2018-11-30 00:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:19:58 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-30 00:20:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:20:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:20:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:20:49 [DEBUG   ] Got command RPT from MCS: ref #672103
2018-11-30 00:20:49 [DEBUG   ] summary = ERROR
2018-11-30 00:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672103  13 58452  1249837 A  ERRORERROR'
2018-11-30 00:20:49 [DEBUG   ] Got command RPT from MCS: ref #672104
2018-11-30 00:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672104  77 58452  1249838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:20:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:20:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:20:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:20:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:20:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:20:59 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-11-30 00:21:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:21:20 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-30 00:21:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 00:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 00:21:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:21:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:21:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:21:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:21:59 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-30 00:22:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 00:22:21 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 00:22:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:22:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:22:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:22:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:22:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:22:59 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-30 00:23:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:23:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:23:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 00:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:23:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:23:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:23:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:23:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:23:59 [DEBUG   ] Finished updating board flags in 1.072 seconds
2018-11-30 00:24:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:24:05 [DEBUG   ] Got command RPT from MCS: ref #672126
2018-11-30 00:24:05 [DEBUG   ] summary = ERROR
2018-11-30 00:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672126  13 58452  1445285 A  ERRORERROR'
2018-11-30 00:24:05 [DEBUG   ] Got command RPT from MCS: ref #672127
2018-11-30 00:24:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672127  77 58452  1445489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:24:05 [DEBUG   ] Got command RPT from MCS: ref #672128
2018-11-30 00:24:05 [DEBUG   ] summary = ERROR
2018-11-30 00:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672128  13 58452  1445693 A  ERRORERROR'
2018-11-30 00:24:05 [DEBUG   ] Got command RPT from MCS: ref #672130
2018-11-30 00:24:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672130  77 58452  1445897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:24:06 [DEBUG   ] Got command RPT from MCS: ref #672132
2018-11-30 00:24:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672132  12 58452  1446089 A  ERRORB›™š'
2018-11-30 00:24:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:24:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:24:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 00:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:25:00 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-11-30 00:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:25:00 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-30 00:25:20 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-30 00:25:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:25:49 [DEBUG   ] Got command RPT from MCS: ref #672136
2018-11-30 00:25:49 [DEBUG   ] summary = ERROR
2018-11-30 00:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672136  13 58452  1549849 A  ERRORERROR'
2018-11-30 00:25:49 [DEBUG   ] Got command RPT from MCS: ref #672137
2018-11-30 00:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672137  77 58452  1549850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:26:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:26:00 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-30 00:26:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:26:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:26:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:26:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:26:59 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-30 00:27:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:27:21 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-11-30 00:27:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:27:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:27:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:27:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:27:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:27:59 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-30 00:28:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 00:28:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:28:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 00:28:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:28:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:28:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:28:59 [WARNING ] (13, 1, 'bot')
2018-11-30 00:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:28:59 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-11-30 00:29:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 00:29:05 [DEBUG   ] Got command RPT from MCS: ref #672157
2018-11-30 00:29:05 [DEBUG   ] summary = ERROR
2018-11-30 00:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672157  13 58452  1745381 A  ERRORERROR'
2018-11-30 00:29:05 [DEBUG   ] Got command RPT from MCS: ref #672158
2018-11-30 00:29:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672158  77 58452  1745573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:29:05 [DEBUG   ] Got command RPT from MCS: ref #672159
2018-11-30 00:29:05 [DEBUG   ] summary = ERROR
2018-11-30 00:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672159  13 58452  1745781 A  ERRORERROR'
2018-11-30 00:29:05 [DEBUG   ] Got command RPT from MCS: ref #672160
2018-11-30 00:29:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672160  77 58452  1745985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:29:06 [DEBUG   ] Got command RPT from MCS: ref #672161
2018-11-30 00:29:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672161  12 58452  1746177 A  ERRORB™™š'
2018-11-30 00:29:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 00:29:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:30:00 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-30 00:30:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 00:30:21 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-30 00:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 00:30:49 [DEBUG   ] Got command RPT from MCS: ref #672166
2018-11-30 00:30:49 [DEBUG   ] summary = ERROR
2018-11-30 00:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672166  13 58452  1849850 A  ERRORERROR'
2018-11-30 00:30:49 [DEBUG   ] Got command RPT from MCS: ref #672167
2018-11-30 00:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672167  77 58452  1849850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:31:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:31:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:31:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:31:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:31:00 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-30 00:31:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 00:31:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 00:31:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:32:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:32:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:32:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:32:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:32:00 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-30 00:32:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:32:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:32:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:33:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 00:33:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:33:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:33:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:33:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:33:02 [DEBUG   ] Finished updating board flags in 3.153 seconds
2018-11-30 00:33:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 00:33:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:34:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:34:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:34:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:34:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:34:00 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-30 00:34:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 00:34:05 [DEBUG   ] Got command RPT from MCS: ref #672189
2018-11-30 00:34:05 [DEBUG   ] summary = ERROR
2018-11-30 00:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672189  13 58452  2045461 A  ERRORERROR'
2018-11-30 00:34:05 [DEBUG   ] Got command RPT from MCS: ref #672190
2018-11-30 00:34:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672190  77 58452  2045665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:34:05 [DEBUG   ] Got command RPT from MCS: ref #672191
2018-11-30 00:34:05 [DEBUG   ] summary = ERROR
2018-11-30 00:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672191  13 58452  2045869 A  ERRORERROR'
2018-11-30 00:34:06 [DEBUG   ] Got command RPT from MCS: ref #672193
2018-11-30 00:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672193  77 58452  2046061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:34:06 [DEBUG   ] Got command RPT from MCS: ref #672195
2018-11-30 00:34:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672195  12 58452  2046265 A  ERRORB˜™š'
2018-11-30 00:34:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 00:34:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 00:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:35:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 00:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:35:01 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-11-30 00:35:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:35:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:35:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:35:49 [DEBUG   ] Got command RPT from MCS: ref #672203
2018-11-30 00:35:49 [DEBUG   ] summary = ERROR
2018-11-30 00:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672203  13 58452  2149845 A  ERRORERROR'
2018-11-30 00:35:49 [DEBUG   ] Got command RPT from MCS: ref #672204
2018-11-30 00:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672204  77 58452  2149846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:36:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:36:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:36:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:36:00 [WARNING ] (13, 1, 'bot')
2018-11-30 00:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:36:00 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-11-30 00:36:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:36:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:36:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:37:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 00:37:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:37:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:37:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:37:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:37:01 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-11-30 00:37:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:37:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:37:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:38:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 00:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:38:01 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-30 00:38:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:38:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:38:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:39:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 00:39:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 00:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:39:01 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-30 00:39:02 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-30 00:39:05 [DEBUG   ] Got command RPT from MCS: ref #672224
2018-11-30 00:39:05 [DEBUG   ] summary = ERROR
2018-11-30 00:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672224  13 58452  2345553 A  ERRORERROR'
2018-11-30 00:39:05 [DEBUG   ] Got command RPT from MCS: ref #672225
2018-11-30 00:39:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672225  77 58452  2345745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:39:05 [DEBUG   ] Got command RPT from MCS: ref #672226
2018-11-30 00:39:05 [DEBUG   ] summary = ERROR
2018-11-30 00:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672226  13 58452  2345949 A  ERRORERROR'
2018-11-30 00:39:06 [DEBUG   ] Got command RPT from MCS: ref #672227
2018-11-30 00:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672227  77 58452  2346153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:39:06 [DEBUG   ] Got command RPT from MCS: ref #672228
2018-11-30 00:39:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672228  12 58452  2346357 A  ERRORB™™š'
2018-11-30 00:39:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 00:39:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 00:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:40:01 [DEBUG   ] Finished updating board flags in 1.171 seconds
2018-11-30 00:40:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 00:40:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 00:40:42 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 00:40:49 [DEBUG   ] Got command RPT from MCS: ref #672229
2018-11-30 00:40:49 [DEBUG   ] summary = ERROR
2018-11-30 00:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672229  13 58452  2449845 A  ERRORERROR'
2018-11-30 00:40:49 [DEBUG   ] Got command RPT from MCS: ref #672230
2018-11-30 00:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672230  77 58452  2449846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:41:01 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-30 00:41:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:41:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:41:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:42:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:42:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:42:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:42:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:42:02 [DEBUG   ] Finished updating board flags in 1.860 seconds
2018-11-30 00:42:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:42:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:42:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:43:02 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-30 00:43:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:43:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:43:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 00:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:44:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:44:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:44:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:44:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:44:01 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-11-30 00:44:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:44:05 [DEBUG   ] Got command RPT from MCS: ref #672262
2018-11-30 00:44:05 [DEBUG   ] summary = ERROR
2018-11-30 00:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672262  13 58452  2645641 A  ERRORERROR'
2018-11-30 00:44:05 [DEBUG   ] Got command RPT from MCS: ref #672263
2018-11-30 00:44:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672263  77 58452  2645833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:44:06 [DEBUG   ] Got command RPT from MCS: ref #672264
2018-11-30 00:44:06 [DEBUG   ] summary = ERROR
2018-11-30 00:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672264  13 58452  2646037 A  ERRORERROR'
2018-11-30 00:44:06 [DEBUG   ] Got command RPT from MCS: ref #672266
2018-11-30 00:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672266  77 58452  2646241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:44:06 [DEBUG   ] Got command RPT from MCS: ref #672267
2018-11-30 00:44:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672267  12 58452  2646433 A  ERRORBš™š'
2018-11-30 00:44:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:44:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:45:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:45:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:45:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:45:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:45:01 [DEBUG   ] Finished updating board flags in 1.041 seconds
2018-11-30 00:45:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:45:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:45:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:45:49 [DEBUG   ] Got command RPT from MCS: ref #672279
2018-11-30 00:45:49 [DEBUG   ] summary = ERROR
2018-11-30 00:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672279  13 58452  2749853 A  ERRORERROR'
2018-11-30 00:45:49 [DEBUG   ] Got command RPT from MCS: ref #672280
2018-11-30 00:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672280  77 58452  2749854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:46:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:46:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:46:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:46:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:46:01 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-30 00:46:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:46:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:46:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:47:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 00:47:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:47:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:47:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:47:01 [WARNING ] (13, 1, 'bot')
2018-11-30 00:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:47:01 [DEBUG   ] Finished updating board flags in 0.982 seconds
2018-11-30 00:47:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:47:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:47:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:48:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 00:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:48:02 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-11-30 00:48:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:48:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:48:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 00:49:00 [DEBUG   ] Got command RPT from MCS: ref #672300
2018-11-30 00:49:00 [DEBUG   ] summary = ERROR
2018-11-30 00:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672300  13 58452  2940729 A  ERRORERROR'
2018-11-30 00:49:00 [DEBUG   ] Got command RPT from MCS: ref #672301
2018-11-30 00:49:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672301  77 58452  2940741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:49:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 00:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 00:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:49:02 [DEBUG   ] Finished updating board flags in 1.246 seconds
2018-11-30 00:49:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 00:49:05 [DEBUG   ] Got command RPT from MCS: ref #672302
2018-11-30 00:49:05 [DEBUG   ] summary = ERROR
2018-11-30 00:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672302  13 58452  2945725 A  ERRORERROR'
2018-11-30 00:49:05 [DEBUG   ] Got command INI from MCS: ref #672303
2018-11-30 00:49:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-30 00:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   672303   8 58452  2945742 ABOOTING'
2018-11-30 00:49:27 [INFO    ] -------------------
2018-11-30 00:49:27 [INFO    ]  LWA board status
2018-11-30 00:49:27 [INFO    ] -------------------
2018-11-30 00:49:27 [INFO    ] DP 1: 2 lwa27
2018-11-30 00:49:27 [INFO    ] DP 1: 3 lwa24
2018-11-30 00:49:27 [INFO    ] DP 1: 4 lwa23
2018-11-30 00:49:27 [INFO    ] DP 1: 5 lwa18
2018-11-30 00:49:27 [INFO    ] DP 1: 6 lwa10
2018-11-30 00:49:27 [INFO    ] DP 1: 7 lwa32
2018-11-30 00:49:27 [INFO    ] DP 1: 8 lwa11
2018-11-30 00:49:27 [INFO    ] DP 1: 9 lwa30
2018-11-30 00:49:27 [INFO    ] DP 1: 10 lwa12
2018-11-30 00:49:27 [INFO    ] DP 1: 11 lwa8
2018-11-30 00:49:27 [INFO    ] DP 1: 12 lwa13
2018-11-30 00:49:27 [INFO    ] DP 1: 13 lwa26
2018-11-30 00:49:27 [INFO    ] DP 1: 14 lwa14
2018-11-30 00:49:27 [INFO    ] DP 1: 16 lwa22
2018-11-30 00:49:27 [INFO    ] DP 1: 17 lwa20
2018-11-30 00:49:27 [INFO    ] DP 1: 18 lwa1
2018-11-30 00:49:27 [INFO    ] DP 1: 19 lwa5
2018-11-30 00:49:27 [INFO    ] DP 1: 20 lwa25
2018-11-30 00:49:27 [INFO    ] DP 1: 21 lwa35
2018-11-30 00:49:27 [INFO    ] DP 1: 22 lwa19
2018-11-30 00:49:27 [INFO    ] DP 1: 23 lwa21
2018-11-30 00:49:27 [INFO    ] DP 1: 24 lwa6
2018-11-30 00:49:27 [INFO    ] DP 1: 25 lwa7
2018-11-30 00:49:27 [INFO    ] DP 1: 26 lwa33
2018-11-30 00:49:27 [INFO    ] DP 1: 27 lwa15
2018-11-30 00:49:27 [INFO    ] DP 1: 28 lwa28
2018-11-30 00:49:27 [INFO    ] DP 2: 1 lwa16
2018-11-30 00:49:27 [INFO    ] DP 2: 15 lwa34
2018-11-30 00:49:27 [INFO    ] Total of 28 boards
2018-11-30 00:49:27 [INFO    ] Total of 260 stands
2018-11-30 00:49:27 [INFO    ] -------------------
2018-11-30 00:49:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 960
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 961
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 962
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 963
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 964
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 965
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 966
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 967
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 968
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 969
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 970
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 971
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 972
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 973
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 974
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 975
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 976
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 977
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 978
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 979
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 980
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 981
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 982
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 983
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 984
2018-11-30 00:49:33 [DEBUG   ] 2018-11-30 00:49:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 985
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 960 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 961 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 962 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 963 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 964 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 965 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 966 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 967 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 968 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 969 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 970 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 971 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 972 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 973 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 974 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 975 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 976 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 977 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 978 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 979 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 980 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 981 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 982 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 983 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 984 exited with status 0
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 985 exited with status 0
2018-11-30 00:49:46 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] spawn_process: at 2018-11-30 00:49:46 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1016
2018-11-30 00:49:46 [DEBUG   ] 2018-11-30 00:49:46 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1017
2018-11-30 00:49:51 [DEBUG   ] 2018-11-30 00:49:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1016 exited with status 0
2018-11-30 00:49:51 [DEBUG   ] 2018-11-30 00:49:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1017 exited with status 0
2018-11-30 00:49:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-30 00:49:51 [DEBUG   ] spawn_process: at 2018-11-30 00:49:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-30 00:49:51 [DEBUG   ] spawn_process: at 2018-11-30 00:49:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-30 00:49:51 [INFO    ] Setting Beam 1 xbars
2018-11-30 00:49:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-30 00:49:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-30 00:49:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-30 00:49:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-30 00:49:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-30 00:49:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-30 00:49:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-30 00:49:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-30 00:49:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-30 00:49:57 [INFO    ] Setting Beam 2 xbars
2018-11-30 00:49:57 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-30 00:49:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-30 00:49:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-30 00:49:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-30 00:50:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-30 00:50:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-30 00:50:02 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-30 00:50:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-30 00:50:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-30 00:50:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-30 00:50:02 [INFO    ] Setting Beam 3 xbars
2018-11-30 00:50:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-30 00:50:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-30 00:50:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-30 00:50:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-30 00:50:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-30 00:50:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-30 00:50:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-30 00:50:05 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-30 00:50:05 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-30 00:50:05 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-30 00:50:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-30 00:50:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-30 00:50:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-30 00:50:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-30 00:50:08 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-30 00:50:08 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-30 00:50:08 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-30 00:50:08 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-30 00:50:08 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-30 00:50:08 [INFO    ] Setting Beam 4 xbars
2018-11-30 00:50:08 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-30 00:50:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 00:50:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 00:50:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-30 00:50:09 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-30 00:50:10 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-30 00:50:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-30 00:50:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-30 00:50:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-30 00:50:14 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-30 00:50:14 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-30 00:50:14 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-30 00:50:14 [INFO    ] All xbars set
2018-11-30 00:50:14 [INFO    ] Setting adder chain routing for all beams
2018-11-30 00:50:19 [INFO    ] Setting beam ids
2018-11-30 00:50:29 [INFO    ] Starting beam delay calibration
2018-11-30 00:50:41 [INFO    ] Beam 1 latency is 5729
2018-11-30 00:50:41 [INFO    ] Beam 2 latency is 5742
2018-11-30 00:50:41 [INFO    ] Beam 3 latency is 5739
2018-11-30 00:50:41 [INFO    ] Beam 4 latency is 5733
2018-11-30 00:50:41 [INFO    ] Stop calibration
2018-11-30 00:50:49 [INFO    ] Beam delay calibration successful
2018-11-30 00:50:49 [INFO    ] Calibration passed
2018-11-30 00:50:49 [DEBUG   ] spawn_process: at 2018-11-30 00:50:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-30 00:50:49 [DEBUG   ] spawn_process: at 2018-11-30 00:50:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-30 00:50:49 [DEBUG   ] spawn_process: at 2018-11-30 00:50:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-30 00:50:49 [DEBUG   ] spawn_process: at 2018-11-30 00:50:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-30 00:50:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-30 00:50:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 00:50:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 484 ms (1543539049.487 s) with PID 2615 and time 1543539050
2018-11-30 00:50:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-30 00:50:49 [DEBUG   ] Got command RPT from MCS: ref #672308
2018-11-30 00:50:49 [DEBUG   ] summary = BOOTING
2018-11-30 00:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672308  15 58452  3049845 ABOOTINGBOOTING'
2018-11-30 00:50:49 [DEBUG   ] Got command RPT from MCS: ref #672309
2018-11-30 00:50:49 [DEBUG   ] info = Calibration passed
2018-11-30 00:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672309  26 58452  3049847 ABOOTINGCalibration passed'
2018-11-30 00:50:50 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 294 ms (1543539050.296 s) with PID 2638 and time 1543539051
2018-11-30 00:50:51 [DEBUG   ] Finished updating ant stats in 0.952 seconds
2018-11-30 00:50:51 [INFO    ] Started antennas statistics background thread
2018-11-30 00:50:51 [INFO    ] Started board flags background thread
2018-11-30 00:50:51 [INFO    ] Started BAM background thread
2018-11-30 00:50:51 [INFO    ] Finished the INI process (ref. #672303) in 105.676 s
2018-11-30 00:50:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:50:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 00:50:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:50:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:50:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:50:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:50:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:50:52 [DEBUG   ] Finished updating board flags in 1.136 seconds
2018-11-30 00:51:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:51:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:51:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:51:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:51:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:51:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:51:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:51:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:51:52 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-30 00:52:05 [DEBUG   ] Got command RPT from MCS: ref #672325
2018-11-30 00:52:05 [DEBUG   ] summary = ERROR
2018-11-30 00:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672325  13 58452  3125737 A  ERRORERROR'
2018-11-30 00:52:05 [DEBUG   ] Got command RPT from MCS: ref #672326
2018-11-30 00:52:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672326  77 58452  3125738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:52:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:52:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:52:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:52:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:52:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:52:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:52:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:52:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:52:52 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-11-30 00:53:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:53:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:53:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:53:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:53:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:53:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:53:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:53:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:53:52 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-30 00:54:05 [DEBUG   ] Got command RPT from MCS: ref #672333
2018-11-30 00:54:05 [DEBUG   ] summary = ERROR
2018-11-30 00:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672333  13 58452  3245809 A  ERRORERROR'
2018-11-30 00:54:06 [DEBUG   ] Got command RPT from MCS: ref #672334
2018-11-30 00:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672334  77 58452  3246001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:54:06 [DEBUG   ] Got command RPT from MCS: ref #672335
2018-11-30 00:54:06 [DEBUG   ] summary = ERROR
2018-11-30 00:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672335  13 58452  3246205 A  ERRORERROR'
2018-11-30 00:54:06 [DEBUG   ] Got command RPT from MCS: ref #672337
2018-11-30 00:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672337  77 58452  3246409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:54:06 [DEBUG   ] Got command RPT from MCS: ref #672338
2018-11-30 00:54:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672338  12 58452  3246601 A  ERRORB˜™š'
2018-11-30 00:54:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:54:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:54:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:54:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:54:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:54:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:54:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:54:53 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-11-30 00:55:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:55:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:55:49 [DEBUG   ] Got command RPT from MCS: ref #672343
2018-11-30 00:55:49 [DEBUG   ] summary = ERROR
2018-11-30 00:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672343  13 58452  3349853 A  ERRORERROR'
2018-11-30 00:55:49 [DEBUG   ] Got command RPT from MCS: ref #672344
2018-11-30 00:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672344  77 58452  3349854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:55:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:55:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:55:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:55:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:55:52 [WARNING ] (13, 1, 'bot')
2018-11-30 00:55:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:55:52 [DEBUG   ] Finished updating board flags in 0.961 seconds
2018-11-30 00:56:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:56:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:56:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:56:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:56:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:56:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:56:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:56:53 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-11-30 00:57:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:57:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:57:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:57:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:57:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:57:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:57:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:57:53 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-30 00:58:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:58:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 00:58:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 00:58:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 00:58:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:58:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:58:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:58:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:58:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:58:53 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-30 00:59:05 [DEBUG   ] Got command RPT from MCS: ref #672364
2018-11-30 00:59:05 [DEBUG   ] summary = ERROR
2018-11-30 00:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672364  13 58452  3545889 A  ERRORERROR'
2018-11-30 00:59:06 [DEBUG   ] Got command RPT from MCS: ref #672365
2018-11-30 00:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672365  77 58452  3546093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:59:06 [DEBUG   ] Got command RPT from MCS: ref #672366
2018-11-30 00:59:06 [DEBUG   ] summary = ERROR
2018-11-30 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672366  13 58452  3546285 A  ERRORERROR'
2018-11-30 00:59:06 [DEBUG   ] Got command RPT from MCS: ref #672367
2018-11-30 00:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672367  77 58452  3546489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 00:59:06 [DEBUG   ] Got command RPT from MCS: ref #672368
2018-11-30 00:59:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672368  12 58452  3546693 A  ERRORB˜™š'
2018-11-30 00:59:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 00:59:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 00:59:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 00:59:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 00:59:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:59:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:59:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:59:53 [WARNING ] (13, 1, 'bot')
2018-11-30 00:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 00:59:53 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-30 01:00:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:00:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:00:49 [DEBUG   ] Got command RPT from MCS: ref #672373
2018-11-30 01:00:49 [DEBUG   ] summary = ERROR
2018-11-30 01:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672373  13 58452  3649857 A  ERRORERROR'
2018-11-30 01:00:49 [DEBUG   ] Got command RPT from MCS: ref #672374
2018-11-30 01:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672374  77 58452  3649858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:00:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:00:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:00:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:00:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:00:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:00:54 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-11-30 01:01:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:01:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:01:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:01:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:01:53 [WARNING ] (13, 1, 'bot')
2018-11-30 01:01:53 [WARNING ] (13, 1, 'bot')
2018-11-30 01:01:53 [WARNING ] (13, 1, 'bot')
2018-11-30 01:01:53 [WARNING ] (13, 1, 'bot')
2018-11-30 01:01:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:01:53 [DEBUG   ] Finished updating board flags in 1.291 seconds
2018-11-30 01:02:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:02:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:02:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:02:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 01:02:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 01:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:02:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:02:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:02:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:02:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:02:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:02:54 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-11-30 01:03:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:03:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:03:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:03:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 01:03:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:03:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:03:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:03:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:03:54 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-11-30 01:04:05 [DEBUG   ] Got command RPT from MCS: ref #672396
2018-11-30 01:04:05 [DEBUG   ] summary = ERROR
2018-11-30 01:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672396  13 58452  3845977 A  ERRORERROR'
2018-11-30 01:04:06 [DEBUG   ] Got command RPT from MCS: ref #672397
2018-11-30 01:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672397  77 58452  3846181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:04:06 [DEBUG   ] Got command RPT from MCS: ref #672398
2018-11-30 01:04:06 [DEBUG   ] summary = ERROR
2018-11-30 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672398  13 58452  3846373 A  ERRORERROR'
2018-11-30 01:04:06 [DEBUG   ] Got command RPT from MCS: ref #672400
2018-11-30 01:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672400  77 58452  3846577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:04:06 [DEBUG   ] Got command RPT from MCS: ref #672401
2018-11-30 01:04:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672401  12 58452  3846781 A  ERRORB™™š'
2018-11-30 01:04:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:04:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:04:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 01:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 01:04:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:04:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:04:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:04:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:04:54 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-30 01:05:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:05:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 01:05:49 [DEBUG   ] Got command RPT from MCS: ref #672410
2018-11-30 01:05:49 [DEBUG   ] summary = ERROR
2018-11-30 01:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672410  13 58452  3949849 A  ERRORERROR'
2018-11-30 01:05:49 [DEBUG   ] Got command RPT from MCS: ref #672411
2018-11-30 01:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672411  77 58452  3949850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:05:51 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 01:05:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:05:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:05:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:05:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:05:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:05:54 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-11-30 01:06:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:06:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:06:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:06:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:06:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:06:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:06:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:06:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:06:54 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-30 01:07:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:07:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:07:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:07:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:07:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:07:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:07:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:07:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:07:54 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 01:08:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 01:08:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 01:08:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 01:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:08:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:08:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:08:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:08:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:08:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:08:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:08:54 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-30 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #672431
2018-11-30 01:09:06 [DEBUG   ] summary = ERROR
2018-11-30 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672431  13 58452  4146057 A  ERRORERROR'
2018-11-30 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #672432
2018-11-30 01:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672432  77 58452  4146261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #672433
2018-11-30 01:09:06 [DEBUG   ] summary = ERROR
2018-11-30 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672433  13 58452  4146465 A  ERRORERROR'
2018-11-30 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #672434
2018-11-30 01:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672434  77 58452  4146669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #672435
2018-11-30 01:09:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672435  12 58452  4146861 A  ERRORBš™š'
2018-11-30 01:09:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 01:09:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:09:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:09:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:09:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:09:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:09:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:09:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:09:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:09:54 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-30 01:09:58 [DEBUG   ] Got command DRX from MCS: ref #672438
2018-11-30 01:09:58 [INFO    ] sending drx command to lwa16
2018-11-30 01:09:58 [DEBUG   ] run_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 60000000.0 7 9 0']
2018-11-30 01:09:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-30 01:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   672438   8 58452  4198006 A  ERROR'
2018-11-30 01:09:58 [DEBUG   ] Got command DRX from MCS: ref #672439
2018-11-30 01:09:58 [INFO    ] sending drx command to lwa16
2018-11-30 01:09:58 [DEBUG   ] run_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 76000000.0 7 9 0']
2018-11-30 01:09:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-30 01:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   672439   8 58452  4198022 A  ERROR'
2018-11-30 01:09:58 [DEBUG   ] Got command BAM from MCS: ref #672440
2018-11-30 01:09:58 [INFO    ] Finished processing BAM request
2018-11-30 01:09:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672440   8 58452  4198025 A  ERROR'
2018-11-30 01:09:58 [INFO    ] Finished starting DRX
2018-11-30 01:09:58 [INFO    ] Finished starting DRX
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:09:58 [DEBUG   ] spawn_process: at 2018-11-30 01:09:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:10:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:10:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 01:10:39 [DEBUG   ] Got command BAM from MCS: ref #672442
2018-11-30 01:10:39 [INFO    ] Finished processing BAM request
2018-11-30 01:10:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:10:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672442   8 58452  4239025 A  ERROR'
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:10:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:10:39 [DEBUG   ] spawn_process: at 2018-11-30 01:10:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:10:49 [DEBUG   ] Got command RPT from MCS: ref #672443
2018-11-30 01:10:49 [DEBUG   ] summary = ERROR
2018-11-30 01:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672443  13 58452  4249849 A  ERRORERROR'
2018-11-30 01:10:49 [DEBUG   ] Got command RPT from MCS: ref #672444
2018-11-30 01:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672444  77 58452  4249850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:10:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:10:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:10:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:10:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:10:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:10:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:10:54 [DEBUG   ] Finished updating board flags in 1.069 seconds
2018-11-30 01:11:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:11:20 [DEBUG   ] Got command BAM from MCS: ref #672464
2018-11-30 01:11:20 [INFO    ] Finished processing BAM request
2018-11-30 01:11:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672464   8 58452  4280033 A  ERROR'
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:11:20 [DEBUG   ] spawn_process: at 2018-11-30 01:11:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:11:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:11:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:11:55 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-11-30 01:12:01 [DEBUG   ] Got command BAM from MCS: ref #672465
2018-11-30 01:12:01 [INFO    ] Finished processing BAM request
2018-11-30 01:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672465   8 58452  4321033 A  ERROR'
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:12:01 [DEBUG   ] spawn_process: at 2018-11-30 01:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:12:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 01:12:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:12:42 [DEBUG   ] Got command BAM from MCS: ref #672466
2018-11-30 01:12:42 [INFO    ] Finished processing BAM request
2018-11-30 01:12:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672466   8 58452  4362033 A  ERROR'
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:12:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:12:42 [DEBUG   ] spawn_process: at 2018-11-30 01:12:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:12:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:12:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:12:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:12:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:12:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:12:55 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-11-30 01:13:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:13:23 [DEBUG   ] Got command BAM from MCS: ref #672467
2018-11-30 01:13:23 [INFO    ] Finished processing BAM request
2018-11-30 01:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672467   8 58452  4403033 A  ERROR'
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:13:23 [DEBUG   ] spawn_process: at 2018-11-30 01:13:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:13:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:13:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:13:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 01:13:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:13:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:13:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:13:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:13:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:13:54 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-11-30 01:14:04 [DEBUG   ] Got command BAM from MCS: ref #672470
2018-11-30 01:14:04 [INFO    ] Finished processing BAM request
2018-11-30 01:14:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:14:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672470   8 58452  4444029 A  ERROR'
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:14:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:14:04 [DEBUG   ] spawn_process: at 2018-11-30 01:14:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #672471
2018-11-30 01:14:06 [DEBUG   ] summary = ERROR
2018-11-30 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672471  13 58452  4446145 A  ERRORERROR'
2018-11-30 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #672472
2018-11-30 01:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672472  77 58452  4446349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #672473
2018-11-30 01:14:06 [DEBUG   ] summary = ERROR
2018-11-30 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672473  13 58452  4446553 A  ERRORERROR'
2018-11-30 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #672475
2018-11-30 01:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672475  77 58452  4446745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #672476
2018-11-30 01:14:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672476  12 58452  4446949 A  ERRORB�ff'
2018-11-30 01:14:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 01:14:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:14:45 [DEBUG   ] Got command BAM from MCS: ref #672485
2018-11-30 01:14:45 [INFO    ] Finished processing BAM request
2018-11-30 01:14:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672485   8 58452  4485025 A  ERROR'
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:14:45 [DEBUG   ] spawn_process: at 2018-11-30 01:14:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:14:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:14:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:14:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:14:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:14:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:14:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:14:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:14:54 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-30 01:15:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:15:26 [DEBUG   ] Got command BAM from MCS: ref #672486
2018-11-30 01:15:26 [INFO    ] Finished processing BAM request
2018-11-30 01:15:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672486   8 58452  4526033 A  ERROR'
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:15:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:15:26 [DEBUG   ] spawn_process: at 2018-11-30 01:15:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:15:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:15:49 [DEBUG   ] Got command RPT from MCS: ref #672487
2018-11-30 01:15:49 [DEBUG   ] summary = ERROR
2018-11-30 01:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672487  13 58452  4549853 A  ERRORERROR'
2018-11-30 01:15:49 [DEBUG   ] Got command RPT from MCS: ref #672488
2018-11-30 01:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672488  77 58452  4549854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:15:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:15:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:15:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:15:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:15:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:15:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:15:54 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-30 01:16:07 [DEBUG   ] Got command BAM from MCS: ref #672504
2018-11-30 01:16:07 [INFO    ] Finished processing BAM request
2018-11-30 01:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672504   8 58452  4567029 A  ERROR'
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:16:07 [DEBUG   ] spawn_process: at 2018-11-30 01:16:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:16:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:16:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:16:48 [DEBUG   ] Got command BAM from MCS: ref #672505
2018-11-30 01:16:48 [INFO    ] Finished processing BAM request
2018-11-30 01:16:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672505   8 58452  4608033 A  ERROR'
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:16:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:16:48 [DEBUG   ] spawn_process: at 2018-11-30 01:16:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:16:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:16:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:16:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:16:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:16:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:16:54 [DEBUG   ] Finished updating board flags in 1.045 seconds
2018-11-30 01:17:12 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 01:17:29 [DEBUG   ] Got command BAM from MCS: ref #672510
2018-11-30 01:17:29 [INFO    ] Finished processing BAM request
2018-11-30 01:17:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672510   8 58452  4649033 A  ERROR'
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:17:29 [DEBUG   ] spawn_process: at 2018-11-30 01:17:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:17:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:17:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:17:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:17:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:17:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:17:54 [WARNING ] (13, 1, 'bot')
2018-11-30 01:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:17:54 [DEBUG   ] Finished updating board flags in 0.929 seconds
2018-11-30 01:18:09 [DEBUG   ] Got command BAM from MCS: ref #672511
2018-11-30 01:18:09 [INFO    ] Finished processing BAM request
2018-11-30 01:18:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:18:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672511   8 58452  4689029 A  ERROR'
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:18:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:18:09 [DEBUG   ] spawn_process: at 2018-11-30 01:18:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:18:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:18:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:18:49 [DEBUG   ] Got command BAM from MCS: ref #672512
2018-11-30 01:18:49 [INFO    ] Finished processing BAM request
2018-11-30 01:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672512   8 58452  4729029 A  ERROR'
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:18:49 [DEBUG   ] spawn_process: at 2018-11-30 01:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:18:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 01:18:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:18:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:18:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:18:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:18:55 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-11-30 01:19:06 [DEBUG   ] Got command RPT from MCS: ref #672513
2018-11-30 01:19:06 [DEBUG   ] summary = ERROR
2018-11-30 01:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672513  13 58452  4746225 A  ERRORERROR'
2018-11-30 01:19:06 [DEBUG   ] Got command RPT from MCS: ref #672514
2018-11-30 01:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672514  77 58452  4746429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:19:06 [DEBUG   ] Got command RPT from MCS: ref #672515
2018-11-30 01:19:06 [DEBUG   ] summary = ERROR
2018-11-30 01:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672515  13 58452  4746633 A  ERRORERROR'
2018-11-30 01:19:06 [DEBUG   ] Got command RPT from MCS: ref #672516
2018-11-30 01:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672516  77 58452  4746837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:19:07 [DEBUG   ] Got command RPT from MCS: ref #672517
2018-11-30 01:19:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672517  12 58452  4747029 A  ERRORBžff'
2018-11-30 01:19:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:19:29 [DEBUG   ] Got command BAM from MCS: ref #672518
2018-11-30 01:19:29 [INFO    ] Finished processing BAM request
2018-11-30 01:19:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672518   8 58452  4769029 A  ERROR'
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:19:29 [DEBUG   ] spawn_process: at 2018-11-30 01:19:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:19:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:19:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:19:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:19:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:19:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:19:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:19:55 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-30 01:20:09 [DEBUG   ] Got command BAM from MCS: ref #672519
2018-11-30 01:20:09 [INFO    ] Finished processing BAM request
2018-11-30 01:20:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672519   8 58452  4809025 A  ERROR'
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:20:09 [DEBUG   ] spawn_process: at 2018-11-30 01:20:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:20:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:20:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:20:49 [DEBUG   ] Got command BAM from MCS: ref #672524
2018-11-30 01:20:49 [INFO    ] Finished processing BAM request
2018-11-30 01:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672524   8 58452  4849025 A  ERROR'
2018-11-30 01:20:49 [DEBUG   ] Got command RPT from MCS: ref #672525
2018-11-30 01:20:49 [DEBUG   ] summary = ERROR
2018-11-30 01:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672525  13 58452  4849853 A  ERRORERROR'
2018-11-30 01:20:49 [DEBUG   ] Got command RPT from MCS: ref #672526
2018-11-30 01:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672526  77 58452  4849854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:20:49 [DEBUG   ] spawn_process: at 2018-11-30 01:20:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:20:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:20:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:20:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:20:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:20:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:20:55 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-11-30 01:21:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:21:29 [DEBUG   ] Got command BAM from MCS: ref #672542
2018-11-30 01:21:29 [INFO    ] Finished processing BAM request
2018-11-30 01:21:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672542   8 58452  4889033 A  ERROR'
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:21:29 [DEBUG   ] spawn_process: at 2018-11-30 01:21:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:21:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:21:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-30 01:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 01:21:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:21:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:21:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:21:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:21:56 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-11-30 01:22:09 [DEBUG   ] Got command BAM from MCS: ref #672543
2018-11-30 01:22:09 [INFO    ] Finished processing BAM request
2018-11-30 01:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672543   8 58452  4929025 A  ERROR'
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:22:09 [DEBUG   ] spawn_process: at 2018-11-30 01:22:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:22:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:22:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:22:49 [DEBUG   ] Got command BAM from MCS: ref #672544
2018-11-30 01:22:49 [INFO    ] Finished processing BAM request
2018-11-30 01:22:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:22:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672544   8 58452  4969033 A  ERROR'
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:22:49 [DEBUG   ] spawn_process: at 2018-11-30 01:22:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:22:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:22:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:22:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:22:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:22:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:22:55 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-11-30 01:23:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:23:29 [DEBUG   ] Got command BAM from MCS: ref #672549
2018-11-30 01:23:29 [INFO    ] Finished processing BAM request
2018-11-30 01:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672549   8 58452  5009025 A  ERROR'
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:23:29 [DEBUG   ] spawn_process: at 2018-11-30 01:23:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:23:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:23:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 01:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:23:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:23:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:23:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:23:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:23:55 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-30 01:24:06 [DEBUG   ] Got command RPT from MCS: ref #672552
2018-11-30 01:24:06 [DEBUG   ] summary = ERROR
2018-11-30 01:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672552  13 58452  5046309 A  ERRORERROR'
2018-11-30 01:24:06 [DEBUG   ] Got command RPT from MCS: ref #672553
2018-11-30 01:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672553  77 58452  5046513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:24:06 [DEBUG   ] Got command RPT from MCS: ref #672554
2018-11-30 01:24:06 [DEBUG   ] summary = ERROR
2018-11-30 01:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672554  13 58452  5046717 A  ERRORERROR'
2018-11-30 01:24:06 [DEBUG   ] Got command RPT from MCS: ref #672556
2018-11-30 01:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672556  77 58452  5046921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:24:07 [DEBUG   ] Got command RPT from MCS: ref #672557
2018-11-30 01:24:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:24:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672557  12 58452  5047113 A  ERRORBŸff'
2018-11-30 01:24:09 [DEBUG   ] Got command BAM from MCS: ref #672562
2018-11-30 01:24:09 [INFO    ] Finished processing BAM request
2018-11-30 01:24:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672562   8 58452  5049029 A  ERROR'
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:24:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:24:09 [DEBUG   ] spawn_process: at 2018-11-30 01:24:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:24:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:24:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:24:49 [DEBUG   ] Got command BAM from MCS: ref #672563
2018-11-30 01:24:49 [INFO    ] Finished processing BAM request
2018-11-30 01:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672563   8 58452  5089025 A  ERROR'
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:24:49 [DEBUG   ] spawn_process: at 2018-11-30 01:24:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:24:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:24:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:24:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:24:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:24:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:24:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:24:55 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-30 01:25:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:25:29 [DEBUG   ] Got command BAM from MCS: ref #672564
2018-11-30 01:25:29 [INFO    ] Finished processing BAM request
2018-11-30 01:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672564   8 58452  5129025 A  ERROR'
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:25:29 [DEBUG   ] spawn_process: at 2018-11-30 01:25:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:25:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:25:49 [DEBUG   ] Got command RPT from MCS: ref #672565
2018-11-30 01:25:49 [DEBUG   ] summary = ERROR
2018-11-30 01:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672565  13 58452  5149857 A  ERRORERROR'
2018-11-30 01:25:49 [DEBUG   ] Got command RPT from MCS: ref #672566
2018-11-30 01:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672566  77 58452  5149858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:25:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:25:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:25:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:25:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:25:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:25:55 [DEBUG   ] Finished updating board flags in 1.239 seconds
2018-11-30 01:26:09 [DEBUG   ] Got command BAM from MCS: ref #672582
2018-11-30 01:26:09 [INFO    ] Finished processing BAM request
2018-11-30 01:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672582   8 58452  5169029 A  ERROR'
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:26:09 [DEBUG   ] spawn_process: at 2018-11-30 01:26:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:26:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:26:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:26:49 [DEBUG   ] Got command BAM from MCS: ref #672587
2018-11-30 01:26:49 [INFO    ] Finished processing BAM request
2018-11-30 01:26:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672587   8 58452  5209029 A  ERROR'
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:26:49 [DEBUG   ] spawn_process: at 2018-11-30 01:26:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:26:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 01:26:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:26:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:26:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:26:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:26:56 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-11-30 01:27:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:27:29 [DEBUG   ] Got command BAM from MCS: ref #672588
2018-11-30 01:27:29 [INFO    ] Finished processing BAM request
2018-11-30 01:27:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672588   8 58452  5249025 A  ERROR'
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:27:29 [DEBUG   ] spawn_process: at 2018-11-30 01:27:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:27:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:27:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:27:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:27:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:27:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:27:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:27:55 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-11-30 01:28:09 [DEBUG   ] Got command BAM from MCS: ref #672589
2018-11-30 01:28:09 [INFO    ] Finished processing BAM request
2018-11-30 01:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672589   8 58452  5289029 A  ERROR'
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:28:09 [DEBUG   ] spawn_process: at 2018-11-30 01:28:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:28:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:28:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:28:49 [DEBUG   ] Got command BAM from MCS: ref #672590
2018-11-30 01:28:49 [INFO    ] Finished processing BAM request
2018-11-30 01:28:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672590   8 58452  5329029 A  ERROR'
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:28:49 [DEBUG   ] spawn_process: at 2018-11-30 01:28:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:28:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:28:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 01:28:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:28:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:28:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:28:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:28:55 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-30 01:29:06 [DEBUG   ] Got command RPT from MCS: ref #672591
2018-11-30 01:29:06 [DEBUG   ] summary = ERROR
2018-11-30 01:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672591  13 58452  5346401 A  ERRORERROR'
2018-11-30 01:29:06 [DEBUG   ] Got command RPT from MCS: ref #672592
2018-11-30 01:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672592  77 58452  5346605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:29:06 [DEBUG   ] Got command RPT from MCS: ref #672593
2018-11-30 01:29:06 [DEBUG   ] summary = ERROR
2018-11-30 01:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672593  13 58452  5346809 A  ERRORERROR'
2018-11-30 01:29:07 [DEBUG   ] Got command RPT from MCS: ref #672594
2018-11-30 01:29:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672594  77 58452  5347001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:29:07 [DEBUG   ] Got command RPT from MCS: ref #672595
2018-11-30 01:29:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672595  12 58452  5347205 A  ERRORBžff'
2018-11-30 01:29:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:29:29 [DEBUG   ] Got command BAM from MCS: ref #672600
2018-11-30 01:29:29 [INFO    ] Finished processing BAM request
2018-11-30 01:29:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672600   8 58452  5369025 A  ERROR'
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:29:29 [DEBUG   ] spawn_process: at 2018-11-30 01:29:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:29:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:29:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:29:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:29:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:29:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:29:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:29:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:29:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:29:55 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 01:30:09 [DEBUG   ] Got command BAM from MCS: ref #672601
2018-11-30 01:30:09 [INFO    ] Finished processing BAM request
2018-11-30 01:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672601   8 58452  5409025 A  ERROR'
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:30:09 [DEBUG   ] spawn_process: at 2018-11-30 01:30:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:30:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:30:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:30:49 [DEBUG   ] Got command BAM from MCS: ref #672602
2018-11-30 01:30:49 [INFO    ] Finished processing BAM request
2018-11-30 01:30:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672602   8 58452  5449033 A  ERROR'
2018-11-30 01:30:49 [DEBUG   ] Got command RPT from MCS: ref #672603
2018-11-30 01:30:49 [DEBUG   ] summary = ERROR
2018-11-30 01:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672603  13 58452  5449861 A  ERRORERROR'
2018-11-30 01:30:49 [DEBUG   ] Got command RPT from MCS: ref #672604
2018-11-30 01:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672604  77 58452  5449862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:30:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:30:49 [DEBUG   ] spawn_process: at 2018-11-30 01:30:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:30:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:30:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 01:30:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:30:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:30:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:30:55 [WARNING ] (13, 1, 'bot')
2018-11-30 01:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:30:55 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-30 01:31:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:31:29 [DEBUG   ] Got command BAM from MCS: ref #672620
2018-11-30 01:31:29 [INFO    ] Finished processing BAM request
2018-11-30 01:31:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672620   8 58452  5489025 A  ERROR'
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:31:29 [DEBUG   ] spawn_process: at 2018-11-30 01:31:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:31:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:31:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:31:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 01:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:31:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 01:31:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:31:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:31:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:31:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:31:56 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-30 01:32:09 [DEBUG   ] Got command BAM from MCS: ref #672621
2018-11-30 01:32:09 [INFO    ] Finished processing BAM request
2018-11-30 01:32:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:32:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672621   8 58452  5529033 A  ERROR'
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:32:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:32:09 [DEBUG   ] spawn_process: at 2018-11-30 01:32:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:32:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:32:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:32:49 [DEBUG   ] Got command BAM from MCS: ref #672626
2018-11-30 01:32:49 [INFO    ] Finished processing BAM request
2018-11-30 01:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672626   8 58452  5569033 A  ERROR'
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:32:49 [DEBUG   ] spawn_process: at 2018-11-30 01:32:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:32:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 01:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:32:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:32:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:32:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:32:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:32:56 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-30 01:33:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 01:33:29 [DEBUG   ] Got command BAM from MCS: ref #672627
2018-11-30 01:33:29 [INFO    ] Finished processing BAM request
2018-11-30 01:33:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672627   8 58452  5609033 A  ERROR'
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:33:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:33:29 [DEBUG   ] spawn_process: at 2018-11-30 01:33:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:33:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:33:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:33:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 01:33:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:33:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:33:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:33:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:33:57 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-30 01:34:06 [DEBUG   ] Got command RPT from MCS: ref #672630
2018-11-30 01:34:06 [DEBUG   ] summary = ERROR
2018-11-30 01:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672630  13 58452  5646489 A  ERRORERROR'
2018-11-30 01:34:06 [DEBUG   ] Got command RPT from MCS: ref #672631
2018-11-30 01:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672631  77 58452  5646681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:34:06 [DEBUG   ] Got command RPT from MCS: ref #672632
2018-11-30 01:34:06 [DEBUG   ] summary = ERROR
2018-11-30 01:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672632  13 58452  5646885 A  ERRORERROR'
2018-11-30 01:34:07 [DEBUG   ] Got command RPT from MCS: ref #672634
2018-11-30 01:34:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:34:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672634  77 58452  5647089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:34:07 [DEBUG   ] Got command RPT from MCS: ref #672635
2018-11-30 01:34:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:34:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672635  12 58452  5647293 A  ERRORB�ff'
2018-11-30 01:34:09 [DEBUG   ] Got command BAM from MCS: ref #672640
2018-11-30 01:34:09 [INFO    ] Finished processing BAM request
2018-11-30 01:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672640   8 58452  5649025 A  ERROR'
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:34:09 [DEBUG   ] spawn_process: at 2018-11-30 01:34:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:34:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 01:34:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 01:34:49 [DEBUG   ] Got command BAM from MCS: ref #672641
2018-11-30 01:34:49 [INFO    ] Finished processing BAM request
2018-11-30 01:34:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672641   8 58452  5689025 A  ERROR'
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:34:49 [DEBUG   ] spawn_process: at 2018-11-30 01:34:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:34:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 01:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 01:34:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:34:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:34:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:34:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:34:57 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-30 01:35:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 01:35:29 [DEBUG   ] Got command BAM from MCS: ref #672646
2018-11-30 01:35:29 [INFO    ] Finished processing BAM request
2018-11-30 01:35:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672646   8 58452  5729029 A  ERROR'
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:35:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:35:29 [DEBUG   ] spawn_process: at 2018-11-30 01:35:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:35:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:35:49 [DEBUG   ] Got command RPT from MCS: ref #672647
2018-11-30 01:35:49 [DEBUG   ] summary = ERROR
2018-11-30 01:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672647  13 58452  5749857 A  ERRORERROR'
2018-11-30 01:35:49 [DEBUG   ] Got command RPT from MCS: ref #672648
2018-11-30 01:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672648  77 58452  5749858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:35:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:35:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:35:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:35:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:35:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:35:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:35:56 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-30 01:36:09 [DEBUG   ] Got command BAM from MCS: ref #672664
2018-11-30 01:36:09 [INFO    ] Finished processing BAM request
2018-11-30 01:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672664   8 58452  5769029 A  ERROR'
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:36:09 [DEBUG   ] spawn_process: at 2018-11-30 01:36:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:36:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:36:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:36:49 [DEBUG   ] Got command BAM from MCS: ref #672665
2018-11-30 01:36:49 [INFO    ] Finished processing BAM request
2018-11-30 01:36:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672665   8 58452  5809029 A  ERROR'
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:36:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:36:49 [DEBUG   ] spawn_process: at 2018-11-30 01:36:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:36:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 01:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:36:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:36:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:36:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:36:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:36:56 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-11-30 01:37:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:37:29 [DEBUG   ] Got command BAM from MCS: ref #672666
2018-11-30 01:37:29 [INFO    ] Finished processing BAM request
2018-11-30 01:37:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672666   8 58452  5849025 A  ERROR'
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:37:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:37:29 [DEBUG   ] spawn_process: at 2018-11-30 01:37:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:37:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:37:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:37:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:37:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:37:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:37:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:37:56 [DEBUG   ] Finished updating board flags in 1.166 seconds
2018-11-30 01:38:09 [DEBUG   ] Got command BAM from MCS: ref #672667
2018-11-30 01:38:09 [INFO    ] Finished processing BAM request
2018-11-30 01:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672667   8 58452  5889025 A  ERROR'
2018-11-30 01:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:38:09 [DEBUG   ] spawn_process: at 2018-11-30 01:38:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:38:10 [DEBUG   ] spawn_process: at 2018-11-30 01:38:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:38:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:38:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:38:49 [DEBUG   ] Got command BAM from MCS: ref #672672
2018-11-30 01:38:49 [INFO    ] Finished processing BAM request
2018-11-30 01:38:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672672   8 58452  5929033 A  ERROR'
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:38:49 [DEBUG   ] spawn_process: at 2018-11-30 01:38:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:38:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 01:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:38:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:38:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:38:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:38:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:38:56 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-11-30 01:39:06 [DEBUG   ] Got command RPT from MCS: ref #672673
2018-11-30 01:39:06 [DEBUG   ] summary = ERROR
2018-11-30 01:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672673  13 58452  5946565 A  ERRORERROR'
2018-11-30 01:39:06 [DEBUG   ] Got command RPT from MCS: ref #672674
2018-11-30 01:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672674  77 58452  5946769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:39:06 [DEBUG   ] Got command RPT from MCS: ref #672675
2018-11-30 01:39:06 [DEBUG   ] summary = ERROR
2018-11-30 01:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672675  13 58452  5946973 A  ERRORERROR'
2018-11-30 01:39:07 [DEBUG   ] Got command RPT from MCS: ref #672676
2018-11-30 01:39:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:39:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672676  77 58452  5947177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:39:07 [DEBUG   ] Got command RPT from MCS: ref #672677
2018-11-30 01:39:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:39:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672677  12 58452  5947369 A  ERRORB�ff'
2018-11-30 01:39:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 01:39:29 [DEBUG   ] Got command BAM from MCS: ref #672678
2018-11-30 01:39:29 [INFO    ] Finished processing BAM request
2018-11-30 01:39:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672678   8 58452  5969033 A  ERROR'
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:39:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:39:29 [DEBUG   ] spawn_process: at 2018-11-30 01:39:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:39:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:39:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:39:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:39:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:39:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:39:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:39:56 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-30 01:40:09 [DEBUG   ] Got command BAM from MCS: ref #672679
2018-11-30 01:40:09 [INFO    ] Finished processing BAM request
2018-11-30 01:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672679   8 58452  6009033 A  ERROR'
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:40:09 [DEBUG   ] spawn_process: at 2018-11-30 01:40:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:40:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:40:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:40:49 [DEBUG   ] Got command BAM from MCS: ref #672680
2018-11-30 01:40:49 [INFO    ] Finished processing BAM request
2018-11-30 01:40:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672680   8 58452  6049029 A  ERROR'
2018-11-30 01:40:49 [DEBUG   ] Got command RPT from MCS: ref #672681
2018-11-30 01:40:49 [DEBUG   ] summary = ERROR
2018-11-30 01:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672681  13 58452  6049857 A  ERRORERROR'
2018-11-30 01:40:49 [DEBUG   ] Got command RPT from MCS: ref #672682
2018-11-30 01:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672682  77 58452  6049858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:40:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:40:49 [DEBUG   ] spawn_process: at 2018-11-30 01:40:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:40:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:40:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:40:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:40:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:40:56 [WARNING ] (13, 1, 'bot')
2018-11-30 01:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:40:56 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-11-30 01:41:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:41:29 [DEBUG   ] Got command BAM from MCS: ref #672702
2018-11-30 01:41:29 [INFO    ] Finished processing BAM request
2018-11-30 01:41:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672702   8 58452  6089025 A  ERROR'
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:41:29 [DEBUG   ] spawn_process: at 2018-11-30 01:41:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:41:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:41:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:41:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:41:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:41:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:41:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:41:57 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-30 01:42:09 [DEBUG   ] Got command BAM from MCS: ref #672703
2018-11-30 01:42:09 [INFO    ] Finished processing BAM request
2018-11-30 01:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672703   8 58452  6129033 A  ERROR'
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:42:09 [DEBUG   ] spawn_process: at 2018-11-30 01:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:42:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:42:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:42:49 [DEBUG   ] Got command BAM from MCS: ref #672704
2018-11-30 01:42:49 [INFO    ] Finished processing BAM request
2018-11-30 01:42:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:42:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672704   8 58452  6169025 A  ERROR'
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:42:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:42:49 [DEBUG   ] spawn_process: at 2018-11-30 01:42:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:42:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:42:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:42:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:42:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:42:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:42:57 [DEBUG   ] Finished updating board flags in 1.277 seconds
2018-11-30 01:43:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:43:29 [DEBUG   ] Got command BAM from MCS: ref #672705
2018-11-30 01:43:29 [INFO    ] Finished processing BAM request
2018-11-30 01:43:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672705   8 58452  6209026 A  ERROR'
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:43:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:43:29 [DEBUG   ] spawn_process: at 2018-11-30 01:43:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:43:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:43:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:43:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:43:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:43:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:43:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:43:57 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 01:44:06 [DEBUG   ] Got command RPT from MCS: ref #672708
2018-11-30 01:44:06 [DEBUG   ] summary = ERROR
2018-11-30 01:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672708  13 58452  6246657 A  ERRORERROR'
2018-11-30 01:44:06 [DEBUG   ] Got command RPT from MCS: ref #672709
2018-11-30 01:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672709  77 58452  6246861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:44:07 [DEBUG   ] Got command RPT from MCS: ref #672710
2018-11-30 01:44:07 [DEBUG   ] summary = ERROR
2018-11-30 01:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672710  13 58452  6247054 A  ERRORERROR'
2018-11-30 01:44:07 [DEBUG   ] Got command RPT from MCS: ref #672712
2018-11-30 01:44:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672712  77 58452  6247257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:44:07 [DEBUG   ] Got command RPT from MCS: ref #672713
2018-11-30 01:44:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672713  12 58452  6247461 A  ERRORBžff'
2018-11-30 01:44:09 [DEBUG   ] Got command BAM from MCS: ref #672717
2018-11-30 01:44:09 [INFO    ] Finished processing BAM request
2018-11-30 01:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672717   8 58452  6249026 A  ERROR'
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:44:09 [DEBUG   ] spawn_process: at 2018-11-30 01:44:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:44:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:44:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:44:49 [DEBUG   ] Got command BAM from MCS: ref #672723
2018-11-30 01:44:49 [INFO    ] Finished processing BAM request
2018-11-30 01:44:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672723   8 58452  6289026 A  ERROR'
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:44:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:44:49 [DEBUG   ] spawn_process: at 2018-11-30 01:44:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:44:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:44:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:44:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:44:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:44:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:44:57 [DEBUG   ] Finished updating board flags in 1.129 seconds
2018-11-30 01:45:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:45:29 [DEBUG   ] Got command BAM from MCS: ref #672724
2018-11-30 01:45:29 [INFO    ] Finished processing BAM request
2018-11-30 01:45:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672724   8 58452  6329030 A  ERROR'
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:45:29 [DEBUG   ] spawn_process: at 2018-11-30 01:45:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:45:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:45:49 [DEBUG   ] Got command RPT from MCS: ref #672725
2018-11-30 01:45:49 [DEBUG   ] summary = ERROR
2018-11-30 01:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672725  13 58452  6349869 A  ERRORERROR'
2018-11-30 01:45:49 [DEBUG   ] Got command RPT from MCS: ref #672726
2018-11-30 01:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672726  77 58452  6349870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:45:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:45:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 01:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:45:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:45:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:45:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:45:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:45:57 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-30 01:46:09 [DEBUG   ] Got command BAM from MCS: ref #672742
2018-11-30 01:46:09 [INFO    ] Finished processing BAM request
2018-11-30 01:46:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672742   8 58452  6369029 A  ERROR'
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:46:09 [DEBUG   ] spawn_process: at 2018-11-30 01:46:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:46:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:46:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:46:49 [DEBUG   ] Got command BAM from MCS: ref #672743
2018-11-30 01:46:49 [INFO    ] Finished processing BAM request
2018-11-30 01:46:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672743   8 58452  6409029 A  ERROR'
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:46:49 [DEBUG   ] spawn_process: at 2018-11-30 01:46:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:46:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:46:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:46:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:46:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:46:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:46:58 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-30 01:47:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 01:47:29 [DEBUG   ] Got command BAM from MCS: ref #672748
2018-11-30 01:47:29 [INFO    ] Finished processing BAM request
2018-11-30 01:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672748   8 58452  6449025 A  ERROR'
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:47:29 [DEBUG   ] spawn_process: at 2018-11-30 01:47:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:47:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:47:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:47:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:47:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:47:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:47:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:47:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:47:58 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-30 01:48:09 [DEBUG   ] Got command BAM from MCS: ref #672749
2018-11-30 01:48:09 [INFO    ] Finished processing BAM request
2018-11-30 01:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672749   8 58452  6489033 A  ERROR'
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:48:09 [DEBUG   ] spawn_process: at 2018-11-30 01:48:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:48:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 01:48:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 01:48:49 [DEBUG   ] Got command BAM from MCS: ref #672750
2018-11-30 01:48:49 [INFO    ] Finished processing BAM request
2018-11-30 01:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672750   8 58452  6529029 A  ERROR'
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:48:49 [DEBUG   ] spawn_process: at 2018-11-30 01:48:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:48:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 01:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-30 01:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:48:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 01:48:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:48:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:48:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:48:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:48:57 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-11-30 01:49:06 [DEBUG   ] Got command RPT from MCS: ref #672751
2018-11-30 01:49:06 [DEBUG   ] summary = ERROR
2018-11-30 01:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672751  13 58452  6546737 A  ERRORERROR'
2018-11-30 01:49:06 [DEBUG   ] Got command RPT from MCS: ref #672752
2018-11-30 01:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672752  77 58452  6546941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:49:07 [DEBUG   ] Got command RPT from MCS: ref #672753
2018-11-30 01:49:07 [DEBUG   ] summary = ERROR
2018-11-30 01:49:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672753  13 58452  6547145 A  ERRORERROR'
2018-11-30 01:49:07 [DEBUG   ] Got command RPT from MCS: ref #672754
2018-11-30 01:49:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:49:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672754  77 58452  6547349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:49:07 [DEBUG   ] Got command RPT from MCS: ref #672755
2018-11-30 01:49:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:49:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672755  12 58452  6547541 A  ERRORBžff'
2018-11-30 01:49:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:49:29 [DEBUG   ] Got command BAM from MCS: ref #672756
2018-11-30 01:49:29 [INFO    ] Finished processing BAM request
2018-11-30 01:49:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672756   8 58452  6569033 A  ERROR'
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:49:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:49:29 [DEBUG   ] spawn_process: at 2018-11-30 01:49:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:49:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:49:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:49:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:49:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:49:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:49:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:49:57 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-11-30 01:50:09 [DEBUG   ] Got command BAM from MCS: ref #672757
2018-11-30 01:50:09 [INFO    ] Finished processing BAM request
2018-11-30 01:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672757   8 58452  6609033 A  ERROR'
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:50:09 [DEBUG   ] spawn_process: at 2018-11-30 01:50:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:50:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:50:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:50:49 [DEBUG   ] Got command BAM from MCS: ref #672762
2018-11-30 01:50:49 [INFO    ] Finished processing BAM request
2018-11-30 01:50:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672762   8 58452  6649033 A  ERROR'
2018-11-30 01:50:49 [DEBUG   ] Got command RPT from MCS: ref #672763
2018-11-30 01:50:49 [DEBUG   ] summary = ERROR
2018-11-30 01:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672763  13 58452  6649861 A  ERRORERROR'
2018-11-30 01:50:49 [DEBUG   ] Got command RPT from MCS: ref #672764
2018-11-30 01:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672764  77 58452  6649862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:50:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:50:49 [DEBUG   ] spawn_process: at 2018-11-30 01:50:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:50:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:50:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:50:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:50:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:50:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:50:57 [DEBUG   ] Finished updating board flags in 1.132 seconds
2018-11-30 01:51:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:51:29 [DEBUG   ] Got command BAM from MCS: ref #672780
2018-11-30 01:51:29 [INFO    ] Finished processing BAM request
2018-11-30 01:51:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672780   8 58452  6689033 A  ERROR'
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:51:29 [DEBUG   ] spawn_process: at 2018-11-30 01:51:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:51:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:51:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:51:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:51:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:51:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:51:57 [WARNING ] (13, 1, 'bot')
2018-11-30 01:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:51:57 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-11-30 01:52:09 [DEBUG   ] Got command BAM from MCS: ref #672781
2018-11-30 01:52:09 [INFO    ] Finished processing BAM request
2018-11-30 01:52:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672781   8 58452  6729033 A  ERROR'
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:52:09 [DEBUG   ] spawn_process: at 2018-11-30 01:52:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:52:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:52:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:52:49 [DEBUG   ] Got command BAM from MCS: ref #672782
2018-11-30 01:52:49 [INFO    ] Finished processing BAM request
2018-11-30 01:52:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:52:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672782   8 58452  6769033 A  ERROR'
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:52:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:52:49 [DEBUG   ] spawn_process: at 2018-11-30 01:52:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:52:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:52:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:52:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:52:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:52:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:52:58 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-11-30 01:53:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:53:29 [DEBUG   ] Got command BAM from MCS: ref #672787
2018-11-30 01:53:29 [INFO    ] Finished processing BAM request
2018-11-30 01:53:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672787   8 58452  6809029 A  ERROR'
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:53:29 [DEBUG   ] spawn_process: at 2018-11-30 01:53:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:53:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:53:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:53:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 01:53:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:53:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:53:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:53:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:53:58 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-30 01:54:06 [DEBUG   ] Got command RPT from MCS: ref #672790
2018-11-30 01:54:06 [DEBUG   ] summary = ERROR
2018-11-30 01:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672790  13 58452  6846829 A  ERRORERROR'
2018-11-30 01:54:07 [DEBUG   ] Got command RPT from MCS: ref #672791
2018-11-30 01:54:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:54:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672791  77 58452  6847021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:54:07 [DEBUG   ] Got command RPT from MCS: ref #672792
2018-11-30 01:54:07 [DEBUG   ] summary = ERROR
2018-11-30 01:54:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672792  13 58452  6847225 A  ERRORERROR'
2018-11-30 01:54:07 [DEBUG   ] Got command RPT from MCS: ref #672794
2018-11-30 01:54:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:54:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672794  77 58452  6847429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:54:07 [DEBUG   ] Got command RPT from MCS: ref #672796
2018-11-30 01:54:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:54:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672796  12 58452  6847633 A  ERRORBžff'
2018-11-30 01:54:09 [DEBUG   ] Got command BAM from MCS: ref #672798
2018-11-30 01:54:09 [INFO    ] Finished processing BAM request
2018-11-30 01:54:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672798   8 58452  6849029 A  ERROR'
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:54:09 [DEBUG   ] spawn_process: at 2018-11-30 01:54:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:54:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:54:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:54:49 [DEBUG   ] Got command BAM from MCS: ref #672801
2018-11-30 01:54:49 [INFO    ] Finished processing BAM request
2018-11-30 01:54:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672801   8 58452  6889029 A  ERROR'
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:54:49 [DEBUG   ] spawn_process: at 2018-11-30 01:54:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:54:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 01:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 01:54:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:54:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:54:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:54:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:54:58 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-11-30 01:55:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:55:29 [DEBUG   ] Got command BAM from MCS: ref #672802
2018-11-30 01:55:29 [INFO    ] Finished processing BAM request
2018-11-30 01:55:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672802   8 58452  6929033 A  ERROR'
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:55:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:55:29 [DEBUG   ] spawn_process: at 2018-11-30 01:55:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:55:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:55:49 [DEBUG   ] Got command RPT from MCS: ref #672803
2018-11-30 01:55:49 [DEBUG   ] summary = ERROR
2018-11-30 01:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672803  13 58452  6949861 A  ERRORERROR'
2018-11-30 01:55:49 [DEBUG   ] Got command RPT from MCS: ref #672804
2018-11-30 01:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672804  77 58452  6949862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:55:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:55:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:55:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:55:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:55:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:55:58 [DEBUG   ] Finished updating board flags in 1.345 seconds
2018-11-30 01:56:09 [DEBUG   ] Got command BAM from MCS: ref #672820
2018-11-30 01:56:09 [INFO    ] Finished processing BAM request
2018-11-30 01:56:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672820   8 58452  6969033 A  ERROR'
2018-11-30 01:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:56:09 [DEBUG   ] spawn_process: at 2018-11-30 01:56:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:56:10 [DEBUG   ] spawn_process: at 2018-11-30 01:56:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:56:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:56:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:56:50 [DEBUG   ] Got command BAM from MCS: ref #672825
2018-11-30 01:56:50 [INFO    ] Finished processing BAM request
2018-11-30 01:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672825   8 58452  7010025 A  ERROR'
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 01:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 01:56:50 [DEBUG   ] spawn_process: at 2018-11-30 01:56:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 01:56:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:56:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-30 01:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:56:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:56:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:56:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:56:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:56:58 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-11-30 01:57:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:57:31 [DEBUG   ] Got command BAM from MCS: ref #672826
2018-11-30 01:57:31 [INFO    ] Finished processing BAM request
2018-11-30 01:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672826   8 58452  7051025 A  ERROR'
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 01:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 01:57:31 [DEBUG   ] spawn_process: at 2018-11-30 01:57:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 01:57:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:57:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 01:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 01:57:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:57:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:57:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:57:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:57:58 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-30 01:58:12 [DEBUG   ] Got command BAM from MCS: ref #672827
2018-11-30 01:58:12 [INFO    ] Finished processing BAM request
2018-11-30 01:58:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672827   8 58452  7092029 A  ERROR'
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 01:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 01:58:12 [DEBUG   ] spawn_process: at 2018-11-30 01:58:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 01:58:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:58:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 01:58:53 [DEBUG   ] Got command BAM from MCS: ref #672828
2018-11-30 01:58:53 [INFO    ] Finished processing BAM request
2018-11-30 01:58:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:58:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672828   8 58452  7133029 A  ERROR'
2018-11-30 01:58:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 01:58:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 01:58:53 [DEBUG   ] spawn_process: at 2018-11-30 01:58:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 01:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:58:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:58:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:58:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:58:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:58:58 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-30 01:59:06 [DEBUG   ] Got command RPT from MCS: ref #672829
2018-11-30 01:59:06 [DEBUG   ] summary = ERROR
2018-11-30 01:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672829  13 58452  7146909 A  ERRORERROR'
2018-11-30 01:59:07 [DEBUG   ] Got command RPT from MCS: ref #672830
2018-11-30 01:59:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672830  77 58452  7147113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:59:07 [DEBUG   ] Got command RPT from MCS: ref #672831
2018-11-30 01:59:07 [DEBUG   ] summary = ERROR
2018-11-30 01:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672831  13 58452  7147317 A  ERRORERROR'
2018-11-30 01:59:07 [DEBUG   ] Got command RPT from MCS: ref #672832
2018-11-30 01:59:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 01:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672832  77 58452  7147521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 01:59:07 [DEBUG   ] Got command RPT from MCS: ref #672833
2018-11-30 01:59:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 01:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672833  12 58452  7147713 A  ERRORBžff'
2018-11-30 01:59:13 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-30 01:59:34 [DEBUG   ] Got command BAM from MCS: ref #672838
2018-11-30 01:59:34 [INFO    ] Finished processing BAM request
2018-11-30 01:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 01:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672838   8 58452  7174029 A  ERROR'
2018-11-30 01:59:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 01:59:34 [DEBUG   ] spawn_process: at 2018-11-30 01:59:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 01:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 01:59:35 [DEBUG   ] spawn_process: at 2018-11-30 01:59:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 01:59:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 01:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-30 01:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 01:59:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:59:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:59:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:59:58 [WARNING ] (13, 1, 'bot')
2018-11-30 01:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 01:59:58 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-30 02:00:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:00:15 [DEBUG   ] Got command BAM from MCS: ref #672839
2018-11-30 02:00:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672839   8 58452  7215030 A  ERROR'
2018-11-30 02:00:15 [INFO    ] Finished processing BAM request
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:00:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:00:15 [DEBUG   ] spawn_process: at 2018-11-30 02:00:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:00:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:00:49 [DEBUG   ] Got command RPT from MCS: ref #672840
2018-11-30 02:00:49 [DEBUG   ] summary = ERROR
2018-11-30 02:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672840  13 58452  7249865 A  ERRORERROR'
2018-11-30 02:00:49 [DEBUG   ] Got command RPT from MCS: ref #672841
2018-11-30 02:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672841  77 58452  7249866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:00:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:00:56 [DEBUG   ] Got command BAM from MCS: ref #672857
2018-11-30 02:00:56 [INFO    ] Finished processing BAM request
2018-11-30 02:00:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:00:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672857   8 58452  7256025 A  ERROR'
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:00:56 [DEBUG   ] spawn_process: at 2018-11-30 02:00:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:00:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:00:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:00:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:00:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:00:58 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-30 02:01:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:01:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:01:37 [DEBUG   ] Got command BAM from MCS: ref #672858
2018-11-30 02:01:37 [INFO    ] Finished processing BAM request
2018-11-30 02:01:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672858   8 58452  7297033 A  ERROR'
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:01:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:01:37 [DEBUG   ] spawn_process: at 2018-11-30 02:01:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:01:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:01:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:01:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:01:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:01:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:01:58 [DEBUG   ] Finished updating board flags in 1.297 seconds
2018-11-30 02:02:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:02:18 [DEBUG   ] Got command BAM from MCS: ref #672859
2018-11-30 02:02:18 [INFO    ] Finished processing BAM request
2018-11-30 02:02:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672859   8 58452  7338033 A  ERROR'
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:02:18 [DEBUG   ] spawn_process: at 2018-11-30 02:02:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:02:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:02:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 02:02:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:02:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:02:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:02:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:02:58 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-11-30 02:02:59 [DEBUG   ] Got command BAM from MCS: ref #672864
2018-11-30 02:02:59 [INFO    ] Finished processing BAM request
2018-11-30 02:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672864   8 58452  7379025 A  ERROR'
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:02:59 [DEBUG   ] spawn_process: at 2018-11-30 02:02:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:03:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:03:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:03:40 [DEBUG   ] Got command BAM from MCS: ref #672865
2018-11-30 02:03:40 [INFO    ] Finished processing BAM request
2018-11-30 02:03:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672865   8 58452  7420033 A  ERROR'
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:03:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:03:40 [DEBUG   ] spawn_process: at 2018-11-30 02:03:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:03:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 02:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:03:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:03:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:03:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:03:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:03:58 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-11-30 02:04:07 [DEBUG   ] Got command RPT from MCS: ref #672868
2018-11-30 02:04:07 [DEBUG   ] summary = ERROR
2018-11-30 02:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672868  13 58452  7447001 A  ERRORERROR'
2018-11-30 02:04:07 [DEBUG   ] Got command RPT from MCS: ref #672869
2018-11-30 02:04:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672869  77 58452  7447193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:04:07 [DEBUG   ] Got command RPT from MCS: ref #672870
2018-11-30 02:04:07 [DEBUG   ] summary = ERROR
2018-11-30 02:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672870  13 58452  7447397 A  ERRORERROR'
2018-11-30 02:04:07 [DEBUG   ] Got command RPT from MCS: ref #672872
2018-11-30 02:04:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672872  77 58452  7447601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:04:07 [DEBUG   ] Got command RPT from MCS: ref #672873
2018-11-30 02:04:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672873  12 58452  7447805 A  ERRORBŸff'
2018-11-30 02:04:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:04:21 [DEBUG   ] Got command BAM from MCS: ref #672878
2018-11-30 02:04:21 [INFO    ] Finished processing BAM request
2018-11-30 02:04:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672878   8 58452  7461029 A  ERROR'
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:04:21 [DEBUG   ] spawn_process: at 2018-11-30 02:04:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:04:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:04:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 02:04:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:04:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:04:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:04:58 [WARNING ] (13, 1, 'bot')
2018-11-30 02:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:04:58 [DEBUG   ] Finished updating board flags in 1.089 seconds
2018-11-30 02:05:02 [DEBUG   ] Got command BAM from MCS: ref #672879
2018-11-30 02:05:02 [INFO    ] Finished processing BAM request
2018-11-30 02:05:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672879   8 58452  7502025 A  ERROR'
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:05:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:05:02 [DEBUG   ] spawn_process: at 2018-11-30 02:05:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:05:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:05:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:05:43 [DEBUG   ] Got command BAM from MCS: ref #672884
2018-11-30 02:05:43 [INFO    ] Finished processing BAM request
2018-11-30 02:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672884   8 58452  7543034 A  ERROR'
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:05:43 [DEBUG   ] spawn_process: at 2018-11-30 02:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:05:49 [DEBUG   ] Got command RPT from MCS: ref #672885
2018-11-30 02:05:49 [DEBUG   ] summary = ERROR
2018-11-30 02:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672885  13 58452  7549873 A  ERRORERROR'
2018-11-30 02:05:49 [DEBUG   ] Got command RPT from MCS: ref #672886
2018-11-30 02:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672886  77 58452  7549874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:05:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:05:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:05:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:05:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:05:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:05:59 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-11-30 02:06:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:06:25 [DEBUG   ] Got command BAM from MCS: ref #672902
2018-11-30 02:06:25 [INFO    ] Finished processing BAM request
2018-11-30 02:06:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672902   8 58452  7585026 A  ERROR'
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:06:25 [DEBUG   ] spawn_process: at 2018-11-30 02:06:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:06:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:06:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:06:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 02:06:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:06:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:06:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:06:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:06:59 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-30 02:07:07 [DEBUG   ] Got command BAM from MCS: ref #672903
2018-11-30 02:07:07 [INFO    ] Finished processing BAM request
2018-11-30 02:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672903   8 58452  7627033 A  ERROR'
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:07:07 [DEBUG   ] spawn_process: at 2018-11-30 02:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:07:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:07:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:07:49 [DEBUG   ] Got command BAM from MCS: ref #672904
2018-11-30 02:07:49 [INFO    ] Finished processing BAM request
2018-11-30 02:07:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:07:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672904   8 58452  7669029 A  ERROR'
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:07:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:07:49 [DEBUG   ] spawn_process: at 2018-11-30 02:07:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:07:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 02:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 02:07:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:07:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:07:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:07:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:07:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:07:59 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-11-30 02:08:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:08:31 [DEBUG   ] Got command BAM from MCS: ref #672909
2018-11-30 02:08:31 [INFO    ] Finished processing BAM request
2018-11-30 02:08:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672909   8 58452  7711033 A  ERROR'
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:08:31 [DEBUG   ] spawn_process: at 2018-11-30 02:08:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:08:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:08:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-30 02:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 02:08:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:08:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:08:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:08:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:08:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:08:59 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-30 02:09:07 [DEBUG   ] Got command RPT from MCS: ref #672910
2018-11-30 02:09:07 [DEBUG   ] summary = ERROR
2018-11-30 02:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672910  13 58452  7747089 A  ERRORERROR'
2018-11-30 02:09:07 [DEBUG   ] Got command RPT from MCS: ref #672911
2018-11-30 02:09:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672911  77 58452  7747281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:09:07 [DEBUG   ] Got command RPT from MCS: ref #672912
2018-11-30 02:09:07 [DEBUG   ] summary = ERROR
2018-11-30 02:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672912  13 58452  7747485 A  ERRORERROR'
2018-11-30 02:09:07 [DEBUG   ] Got command RPT from MCS: ref #672913
2018-11-30 02:09:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672913  77 58452  7747689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:09:07 [DEBUG   ] Got command RPT from MCS: ref #672914
2018-11-30 02:09:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672914  12 58452  7747881 A  ERRORBžff'
2018-11-30 02:09:13 [DEBUG   ] Got command BAM from MCS: ref #672915
2018-11-30 02:09:13 [INFO    ] Finished processing BAM request
2018-11-30 02:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672915   8 58452  7753025 A  ERROR'
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:09:13 [DEBUG   ] spawn_process: at 2018-11-30 02:09:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:09:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:09:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:09:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:09:55 [DEBUG   ] Got command BAM from MCS: ref #672916
2018-11-30 02:09:55 [INFO    ] Finished processing BAM request
2018-11-30 02:09:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672916   8 58452  7795029 A  ERROR'
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:09:55 [DEBUG   ] spawn_process: at 2018-11-30 02:09:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:09:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:09:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:09:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:09:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:09:59 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 02:10:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 02:10:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:10:37 [DEBUG   ] Got command BAM from MCS: ref #672917
2018-11-30 02:10:37 [INFO    ] Finished processing BAM request
2018-11-30 02:10:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672917   8 58452  7837033 A  ERROR'
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:10:37 [DEBUG   ] spawn_process: at 2018-11-30 02:10:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:10:49 [DEBUG   ] Got command RPT from MCS: ref #672918
2018-11-30 02:10:49 [DEBUG   ] summary = ERROR
2018-11-30 02:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672918  13 58452  7849873 A  ERRORERROR'
2018-11-30 02:10:49 [DEBUG   ] Got command RPT from MCS: ref #672919
2018-11-30 02:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672919  77 58452  7849874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:10:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 02:10:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:10:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:10:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:10:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:10:59 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-11-30 02:11:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:11:19 [DEBUG   ] Got command BAM from MCS: ref #672935
2018-11-30 02:11:19 [INFO    ] Finished processing BAM request
2018-11-30 02:11:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672935   8 58452  7879033 A  ERROR'
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:11:19 [DEBUG   ] spawn_process: at 2018-11-30 02:11:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:11:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:11:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:11:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:11:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:11:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:11:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:11:59 [DEBUG   ] Finished updating board flags in 1.122 seconds
2018-11-30 02:12:01 [DEBUG   ] Got command BAM from MCS: ref #672940
2018-11-30 02:12:01 [INFO    ] Finished processing BAM request
2018-11-30 02:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672940   8 58452  7921025 A  ERROR'
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:12:01 [DEBUG   ] spawn_process: at 2018-11-30 02:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:12:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:12:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:12:44 [DEBUG   ] Got command BAM from MCS: ref #672941
2018-11-30 02:12:44 [INFO    ] Finished processing BAM request
2018-11-30 02:12:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:12:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672941   8 58452  7964033 A  ERROR'
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:12:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:12:44 [DEBUG   ] spawn_process: at 2018-11-30 02:12:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:12:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:12:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:12:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:12:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:12:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:12:59 [DEBUG   ] Finished updating board flags in 1.026 seconds
2018-11-30 02:13:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:13:27 [DEBUG   ] Got command BAM from MCS: ref #672942
2018-11-30 02:13:27 [INFO    ] Finished processing BAM request
2018-11-30 02:13:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672942   8 58452  8007025 A  ERROR'
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:13:27 [DEBUG   ] spawn_process: at 2018-11-30 02:13:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:13:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:13:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:13:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 02:13:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:13:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:13:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:13:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:13:59 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-30 02:14:07 [DEBUG   ] Got command RPT from MCS: ref #672945
2018-11-30 02:14:07 [DEBUG   ] summary = ERROR
2018-11-30 02:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672945  13 58452  8047169 A  ERRORERROR'
2018-11-30 02:14:07 [DEBUG   ] Got command RPT from MCS: ref #672946
2018-11-30 02:14:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672946  77 58452  8047373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:14:07 [DEBUG   ] Got command RPT from MCS: ref #672947
2018-11-30 02:14:07 [DEBUG   ] summary = ERROR
2018-11-30 02:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672947  13 58452  8047577 A  ERRORERROR'
2018-11-30 02:14:07 [DEBUG   ] Got command RPT from MCS: ref #672949
2018-11-30 02:14:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672949  77 58452  8047769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:14:07 [DEBUG   ] Got command RPT from MCS: ref #672950
2018-11-30 02:14:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672950  12 58452  8047973 A  ERRORB�ff'
2018-11-30 02:14:10 [DEBUG   ] Got command BAM from MCS: ref #672955
2018-11-30 02:14:10 [INFO    ] Finished processing BAM request
2018-11-30 02:14:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672955   8 58452  8050029 A  ERROR'
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:14:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:14:10 [DEBUG   ] spawn_process: at 2018-11-30 02:14:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:14:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:14:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:14:53 [DEBUG   ] Got command BAM from MCS: ref #672960
2018-11-30 02:14:53 [INFO    ] Finished processing BAM request
2018-11-30 02:14:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672960   8 58452  8093033 A  ERROR'
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:14:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:14:53 [DEBUG   ] spawn_process: at 2018-11-30 02:14:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:14:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:15:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:15:00 [DEBUG   ] Finished updating board flags in 1.968 seconds
2018-11-30 02:15:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 02:15:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:15:36 [DEBUG   ] Got command BAM from MCS: ref #672961
2018-11-30 02:15:36 [INFO    ] Finished processing BAM request
2018-11-30 02:15:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672961   8 58452  8136025 A  ERROR'
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:15:36 [DEBUG   ] spawn_process: at 2018-11-30 02:15:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:15:49 [DEBUG   ] Got command RPT from MCS: ref #672962
2018-11-30 02:15:49 [DEBUG   ] summary = ERROR
2018-11-30 02:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672962  13 58452  8149873 A  ERRORERROR'
2018-11-30 02:15:49 [DEBUG   ] Got command RPT from MCS: ref #672963
2018-11-30 02:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672963  77 58452  8149874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:15:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:15:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:15:59 [DEBUG   ] Finished updating board flags in 1.233 seconds
2018-11-30 02:16:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:16:19 [DEBUG   ] Got command BAM from MCS: ref #672979
2018-11-30 02:16:19 [INFO    ] Finished processing BAM request
2018-11-30 02:16:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:16:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672979   8 58452  8179025 A  ERROR'
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:16:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:16:19 [DEBUG   ] spawn_process: at 2018-11-30 02:16:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:16:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:16:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 02:16:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:16:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:16:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:16:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:16:59 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-30 02:17:02 [DEBUG   ] Got command BAM from MCS: ref #672980
2018-11-30 02:17:02 [INFO    ] Finished processing BAM request
2018-11-30 02:17:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672980   8 58452  8222029 A  ERROR'
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:17:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:17:02 [DEBUG   ] spawn_process: at 2018-11-30 02:17:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:17:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:17:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:17:45 [DEBUG   ] Got command BAM from MCS: ref #672985
2018-11-30 02:17:45 [INFO    ] Finished processing BAM request
2018-11-30 02:17:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:17:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672985   8 58452  8265033 A  ERROR'
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:17:45 [DEBUG   ] spawn_process: at 2018-11-30 02:17:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:17:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:17:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:17:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:17:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:17:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:17:59 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-30 02:18:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:18:29 [DEBUG   ] Got command BAM from MCS: ref #672986
2018-11-30 02:18:29 [INFO    ] Finished processing BAM request
2018-11-30 02:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672986   8 58452  8309025 A  ERROR'
2018-11-30 02:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:18:29 [DEBUG   ] spawn_process: at 2018-11-30 02:18:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:18:30 [DEBUG   ] spawn_process: at 2018-11-30 02:18:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:18:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:18:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 02:18:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:18:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:18:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:18:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:18:59 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-11-30 02:19:07 [DEBUG   ] Got command RPT from MCS: ref #672987
2018-11-30 02:19:07 [DEBUG   ] summary = ERROR
2018-11-30 02:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672987  13 58452  8347261 A  ERRORERROR'
2018-11-30 02:19:07 [DEBUG   ] Got command RPT from MCS: ref #672988
2018-11-30 02:19:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672988  77 58452  8347453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:19:07 [DEBUG   ] Got command RPT from MCS: ref #672989
2018-11-30 02:19:07 [DEBUG   ] summary = ERROR
2018-11-30 02:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672989  13 58452  8347657 A  ERRORERROR'
2018-11-30 02:19:07 [DEBUG   ] Got command RPT from MCS: ref #672990
2018-11-30 02:19:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672990  77 58452  8347861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:19:08 [DEBUG   ] Got command RPT from MCS: ref #672991
2018-11-30 02:19:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672991  12 58452  8348065 A  ERRORBžff'
2018-11-30 02:19:13 [DEBUG   ] Got command BAM from MCS: ref #672992
2018-11-30 02:19:13 [INFO    ] Finished processing BAM request
2018-11-30 02:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672992   8 58452  8353025 A  ERROR'
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:19:13 [DEBUG   ] spawn_process: at 2018-11-30 02:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:19:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:19:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:19:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:19:57 [DEBUG   ] Got command BAM from MCS: ref #672993
2018-11-30 02:19:57 [INFO    ] Finished processing BAM request
2018-11-30 02:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672993   8 58452  8397029 A  ERROR'
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:19:57 [DEBUG   ] spawn_process: at 2018-11-30 02:19:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-30 02:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:19:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:19:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:19:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:19:59 [WARNING ] (13, 1, 'bot')
2018-11-30 02:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:19:59 [DEBUG   ] Finished updating board flags in 1.120 seconds
2018-11-30 02:20:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 02:20:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:20:41 [DEBUG   ] Got command BAM from MCS: ref #672998
2018-11-30 02:20:41 [INFO    ] Finished processing BAM request
2018-11-30 02:20:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:20:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   672998   8 58452  8441029 A  ERROR'
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:20:41 [DEBUG   ] spawn_process: at 2018-11-30 02:20:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:20:49 [DEBUG   ] Got command RPT from MCS: ref #672999
2018-11-30 02:20:49 [DEBUG   ] summary = ERROR
2018-11-30 02:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672999  13 58452  8449873 A  ERRORERROR'
2018-11-30 02:20:49 [DEBUG   ] Got command RPT from MCS: ref #673000
2018-11-30 02:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673000  77 58452  8449874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:20:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:21:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:21:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:21:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:21:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:21:00 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-11-30 02:21:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 02:21:25 [DEBUG   ] Got command BAM from MCS: ref #673016
2018-11-30 02:21:25 [INFO    ] Finished processing BAM request
2018-11-30 02:21:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673016   8 58452  8485033 A  ERROR'
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:21:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:21:25 [DEBUG   ] spawn_process: at 2018-11-30 02:21:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:21:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 02:21:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 02:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:22:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:22:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:22:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:22:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:22:00 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-30 02:22:09 [DEBUG   ] Got command BAM from MCS: ref #673017
2018-11-30 02:22:09 [INFO    ] Finished processing BAM request
2018-11-30 02:22:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:22:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673017   8 58452  8529029 A  ERROR'
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:22:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:22:09 [DEBUG   ] spawn_process: at 2018-11-30 02:22:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:22:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 02:22:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 02:22:53 [DEBUG   ] Got command BAM from MCS: ref #673018
2018-11-30 02:22:53 [INFO    ] Finished processing BAM request
2018-11-30 02:22:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:22:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673018   8 58452  8573033 A  ERROR'
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:22:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:22:53 [DEBUG   ] spawn_process: at 2018-11-30 02:22:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:22:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 02:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:23:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:23:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:23:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:23:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:23:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:23:00 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-30 02:23:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 02:23:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:23:38 [DEBUG   ] Got command BAM from MCS: ref #673023
2018-11-30 02:23:38 [INFO    ] Finished processing BAM request
2018-11-30 02:23:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673023   8 58452  8618033 A  ERROR'
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:23:38 [DEBUG   ] spawn_process: at 2018-11-30 02:23:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:23:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:24:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:24:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:24:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:24:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:24:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:24:00 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-30 02:24:07 [DEBUG   ] Got command RPT from MCS: ref #673026
2018-11-30 02:24:07 [DEBUG   ] summary = ERROR
2018-11-30 02:24:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673026  13 58452  8647337 A  ERRORERROR'
2018-11-30 02:24:07 [DEBUG   ] Got command RPT from MCS: ref #673027
2018-11-30 02:24:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:24:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673027  77 58452  8647541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:24:07 [DEBUG   ] Got command RPT from MCS: ref #673028
2018-11-30 02:24:07 [DEBUG   ] summary = ERROR
2018-11-30 02:24:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673028  13 58452  8647745 A  ERRORERROR'
2018-11-30 02:24:07 [DEBUG   ] Got command RPT from MCS: ref #673030
2018-11-30 02:24:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:24:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673030  77 58452  8647949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:24:08 [DEBUG   ] Got command RPT from MCS: ref #673031
2018-11-30 02:24:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:24:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673031  12 58452  8648141 A  ERRORBžff'
2018-11-30 02:24:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:24:23 [DEBUG   ] Got command BAM from MCS: ref #673036
2018-11-30 02:24:23 [INFO    ] Finished processing BAM request
2018-11-30 02:24:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673036   8 58452  8663025 A  ERROR'
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 02:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 02:24:23 [DEBUG   ] spawn_process: at 2018-11-30 02:24:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 02:24:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 02:24:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 02:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:25:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:25:00 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-30 02:25:08 [DEBUG   ] Got command BAM from MCS: ref #673037
2018-11-30 02:25:08 [INFO    ] Finished processing BAM request
2018-11-30 02:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673037   8 58452  8708029 A  ERROR'
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:25:08 [DEBUG   ] spawn_process: at 2018-11-30 02:25:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:25:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:25:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:25:49 [DEBUG   ] Got command RPT from MCS: ref #673038
2018-11-30 02:25:49 [DEBUG   ] summary = ERROR
2018-11-30 02:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673038  13 58452  8749873 A  ERRORERROR'
2018-11-30 02:25:49 [DEBUG   ] Got command RPT from MCS: ref #673039
2018-11-30 02:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673039  77 58452  8749874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:25:53 [DEBUG   ] Got command BAM from MCS: ref #673055
2018-11-30 02:25:53 [INFO    ] Finished processing BAM request
2018-11-30 02:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673055   8 58452  8753033 A  ERROR'
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:25:53 [DEBUG   ] spawn_process: at 2018-11-30 02:25:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:25:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:26:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:26:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:26:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:26:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:26:01 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-11-30 02:26:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:26:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:26:38 [DEBUG   ] Got command BAM from MCS: ref #673060
2018-11-30 02:26:38 [INFO    ] Finished processing BAM request
2018-11-30 02:26:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673060   8 58452  8798029 A  ERROR'
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:26:38 [DEBUG   ] spawn_process: at 2018-11-30 02:26:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:26:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:27:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:27:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:27:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:27:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:27:01 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-30 02:27:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 02:27:24 [DEBUG   ] Got command BAM from MCS: ref #673061
2018-11-30 02:27:24 [INFO    ] Finished processing BAM request
2018-11-30 02:27:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673061   8 58452  8844029 A  ERROR'
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:27:24 [DEBUG   ] spawn_process: at 2018-11-30 02:27:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:27:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:27:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:28:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:28:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:28:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:28:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:28:00 [DEBUG   ] Finished updating board flags in 1.050 seconds
2018-11-30 02:28:10 [DEBUG   ] Got command BAM from MCS: ref #673062
2018-11-30 02:28:10 [INFO    ] Finished processing BAM request
2018-11-30 02:28:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673062   8 58452  8890025 A  ERROR'
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:28:10 [DEBUG   ] spawn_process: at 2018-11-30 02:28:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:28:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:28:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:28:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:28:56 [DEBUG   ] Got command BAM from MCS: ref #673063
2018-11-30 02:28:56 [INFO    ] Finished processing BAM request
2018-11-30 02:28:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:28:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673063   8 58452  8936029 A  ERROR'
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:28:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:28:56 [DEBUG   ] spawn_process: at 2018-11-30 02:28:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:29:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:29:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:29:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:29:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:29:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:29:00 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-30 02:29:07 [DEBUG   ] Got command RPT from MCS: ref #673064
2018-11-30 02:29:07 [DEBUG   ] summary = ERROR
2018-11-30 02:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673064  13 58452  8947425 A  ERRORERROR'
2018-11-30 02:29:07 [DEBUG   ] Got command RPT from MCS: ref #673065
2018-11-30 02:29:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673065  77 58452  8947629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:29:07 [DEBUG   ] Got command RPT from MCS: ref #673066
2018-11-30 02:29:07 [DEBUG   ] summary = ERROR
2018-11-30 02:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673066  13 58452  8947833 A  ERRORERROR'
2018-11-30 02:29:08 [DEBUG   ] Got command RPT from MCS: ref #673067
2018-11-30 02:29:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673067  77 58452  8948037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:29:08 [DEBUG   ] Got command RPT from MCS: ref #673068
2018-11-30 02:29:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673068  12 58452  8948229 A  ERRORB�ff'
2018-11-30 02:29:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:29:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:29:42 [DEBUG   ] Got command BAM from MCS: ref #673073
2018-11-30 02:29:42 [INFO    ] Finished processing BAM request
2018-11-30 02:29:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673073   8 58452  8982029 A  ERROR'
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:29:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:29:42 [DEBUG   ] spawn_process: at 2018-11-30 02:29:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:29:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 02:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:30:00 [WARNING ] (13, 1, 'bot')
2018-11-30 02:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:30:00 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-11-30 02:30:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:30:28 [DEBUG   ] Got command BAM from MCS: ref #673074
2018-11-30 02:30:28 [INFO    ] Finished processing BAM request
2018-11-30 02:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673074   8 58452  9028025 A  ERROR'
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:30:28 [DEBUG   ] spawn_process: at 2018-11-30 02:30:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:30:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:30:49 [DEBUG   ] Got command RPT from MCS: ref #673075
2018-11-30 02:30:49 [DEBUG   ] summary = ERROR
2018-11-30 02:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673075  13 58452  9049877 A  ERRORERROR'
2018-11-30 02:30:49 [DEBUG   ] Got command RPT from MCS: ref #673076
2018-11-30 02:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673076  77 58452  9049878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:30:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:31:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:31:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:31:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:31:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:31:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:31:01 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-11-30 02:31:14 [DEBUG   ] Got command BAM from MCS: ref #673092
2018-11-30 02:31:14 [INFO    ] Finished processing BAM request
2018-11-30 02:31:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:31:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673092   8 58452  9074033 A  ERROR'
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:31:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:31:14 [DEBUG   ] spawn_process: at 2018-11-30 02:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:31:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:31:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:31:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 02:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:32:01 [DEBUG   ] Got command BAM from MCS: ref #673093
2018-11-30 02:32:01 [INFO    ] Finished processing BAM request
2018-11-30 02:32:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673093   8 58452  9121029 A  ERROR'
2018-11-30 02:32:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:32:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:32:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:32:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:32:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:32:01 [DEBUG   ] Finished updating board flags in 1.320 seconds
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:32:01 [DEBUG   ] spawn_process: at 2018-11-30 02:32:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:32:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:32:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:32:48 [DEBUG   ] Got command BAM from MCS: ref #673098
2018-11-30 02:32:48 [INFO    ] Finished processing BAM request
2018-11-30 02:32:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:32:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673098   8 58452  9168029 A  ERROR'
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:32:48 [DEBUG   ] spawn_process: at 2018-11-30 02:32:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:32:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:33:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:33:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:33:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:33:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:33:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:33:01 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-30 02:33:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 02:33:35 [DEBUG   ] Got command BAM from MCS: ref #673099
2018-11-30 02:33:35 [INFO    ] Finished processing BAM request
2018-11-30 02:33:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673099   8 58452  9215033 A  ERROR'
2018-11-30 02:33:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:33:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:33:35 [DEBUG   ] spawn_process: at 2018-11-30 02:33:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:33:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 02:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 02:34:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:34:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:34:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:34:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:34:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:34:01 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-30 02:34:07 [DEBUG   ] Got command RPT from MCS: ref #673102
2018-11-30 02:34:07 [DEBUG   ] summary = ERROR
2018-11-30 02:34:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673102  13 58452  9247521 A  ERRORERROR'
2018-11-30 02:34:07 [DEBUG   ] Got command RPT from MCS: ref #673103
2018-11-30 02:34:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:34:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673103  77 58452  9247713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:34:07 [DEBUG   ] Got command RPT from MCS: ref #673104
2018-11-30 02:34:07 [DEBUG   ] summary = ERROR
2018-11-30 02:34:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673104  13 58452  9247917 A  ERRORERROR'
2018-11-30 02:34:08 [DEBUG   ] Got command RPT from MCS: ref #673106
2018-11-30 02:34:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:34:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673106  77 58452  9248121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:34:08 [DEBUG   ] Got command RPT from MCS: ref #673108
2018-11-30 02:34:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:34:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673108  12 58452  9248313 A  ERRORBžff'
2018-11-30 02:34:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:34:22 [DEBUG   ] Got command BAM from MCS: ref #673112
2018-11-30 02:34:22 [INFO    ] Finished processing BAM request
2018-11-30 02:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673112   8 58452  9262033 A  ERROR'
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:34:22 [DEBUG   ] spawn_process: at 2018-11-30 02:34:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:34:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:34:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:35:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 02:35:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 02:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:35:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:35:01 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-11-30 02:35:10 [DEBUG   ] Got command BAM from MCS: ref #673113
2018-11-30 02:35:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673113   8 58452  9310194 A  ERROR'
2018-11-30 02:35:10 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-30 02:35:10 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-30 02:35:10 [INFO    ] Finished processing BAM request
2018-11-30 02:35:10 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-30 02:35:10 [DEBUG   ] 
2018-11-30 02:35:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:35:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:35:49 [DEBUG   ] Got command RPT from MCS: ref #673118
2018-11-30 02:35:49 [DEBUG   ] summary = ERROR
2018-11-30 02:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673118  13 58452  9349877 A  ERRORERROR'
2018-11-30 02:35:49 [DEBUG   ] Got command RPT from MCS: ref #673119
2018-11-30 02:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673119  77 58452  9349878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:35:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:35:58 [DEBUG   ] Got command BAM from MCS: ref #673135
2018-11-30 02:35:58 [INFO    ] Finished processing BAM request
2018-11-30 02:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673135   8 58452  9358030 A  ERROR'
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:35:58 [DEBUG   ] spawn_process: at 2018-11-30 02:35:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:36:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:36:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:36:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:36:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:36:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:36:01 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-11-30 02:36:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:36:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:36:46 [DEBUG   ] Got command BAM from MCS: ref #673136
2018-11-30 02:36:46 [INFO    ] Finished processing BAM request
2018-11-30 02:36:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673136   8 58452  9406034 A  ERROR'
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 02:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 02:36:46 [DEBUG   ] spawn_process: at 2018-11-30 02:36:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 02:36:55 [DEBUG   ] Finished updating ant stats in 0.563 seconds
2018-11-30 02:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:37:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:37:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:37:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:37:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:37:02 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 02:37:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 02:37:34 [DEBUG   ] Got command BAM from MCS: ref #673137
2018-11-30 02:37:34 [INFO    ] Finished processing BAM request
2018-11-30 02:37:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673137   8 58452  9454026 A  ERROR'
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 02:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 02:37:34 [DEBUG   ] spawn_process: at 2018-11-30 02:37:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 02:37:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:37:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 02:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:38:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 02:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:38:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:38:01 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-11-30 02:38:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 02:38:23 [DEBUG   ] Got command BAM from MCS: ref #673142
2018-11-30 02:38:23 [INFO    ] Finished processing BAM request
2018-11-30 02:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673142   8 58452  9503026 A  ERROR'
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:38:23 [DEBUG   ] spawn_process: at 2018-11-30 02:38:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:38:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:38:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:39:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:39:01 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-30 02:39:07 [DEBUG   ] Got command RPT from MCS: ref #673143
2018-11-30 02:39:07 [DEBUG   ] summary = ERROR
2018-11-30 02:39:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673143  13 58452  9547605 A  ERRORERROR'
2018-11-30 02:39:07 [DEBUG   ] Got command RPT from MCS: ref #673144
2018-11-30 02:39:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:39:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673144  77 58452  9547798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:39:08 [DEBUG   ] Got command RPT from MCS: ref #673145
2018-11-30 02:39:08 [DEBUG   ] summary = ERROR
2018-11-30 02:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673145  13 58452  9548002 A  ERRORERROR'
2018-11-30 02:39:08 [DEBUG   ] Got command RPT from MCS: ref #673146
2018-11-30 02:39:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673146  77 58452  9548205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:39:08 [DEBUG   ] Got command RPT from MCS: ref #673147
2018-11-30 02:39:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673147  12 58452  9548409 A  ERRORBžff'
2018-11-30 02:39:12 [DEBUG   ] Got command BAM from MCS: ref #673148
2018-11-30 02:39:12 [INFO    ] Finished processing BAM request
2018-11-30 02:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 02:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673148   8 58452  9552026 A  ERROR'
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 02:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 02:39:12 [DEBUG   ] spawn_process: at 2018-11-30 02:39:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 02:39:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:39:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 02:39:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 02:40:00 [DEBUG   ] Got command STP from MCS: ref #673149
2018-11-30 02:40:00 [INFO    ] Finished processing BAM request
2018-11-30 02:40:00 [INFO    ] Shutdown the adder chain on beam #4
2018-11-30 02:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   673149   8 58452  9600029 A  ERROR'
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 02:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 02:40:00 [DEBUG   ] spawn_process: at 2018-11-30 02:40:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 02:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:40:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 02:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:40:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:40:01 [DEBUG   ] Finished updating board flags in 1.166 seconds
2018-11-30 02:40:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 02:40:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:40:49 [DEBUG   ] Got command RPT from MCS: ref #673150
2018-11-30 02:40:49 [DEBUG   ] summary = ERROR
2018-11-30 02:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673150  13 58452  9649881 A  ERRORERROR'
2018-11-30 02:40:49 [DEBUG   ] Got command RPT from MCS: ref #673151
2018-11-30 02:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673151  77 58452  9649882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:40:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 02:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 02:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:41:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:41:01 [DEBUG   ] Finished updating board flags in 1.104 seconds
2018-11-30 02:41:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:41:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:41:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 02:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 02:42:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:42:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:42:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:42:01 [WARNING ] (13, 1, 'bot')
2018-11-30 02:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:42:01 [DEBUG   ] Finished updating board flags in 0.902 seconds
2018-11-30 02:42:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 02:42:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:42:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:43:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:43:02 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-11-30 02:43:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:43:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:43:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:44:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:44:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:44:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:44:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:44:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:44:02 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-30 02:44:07 [DEBUG   ] Got command RPT from MCS: ref #673173
2018-11-30 02:44:07 [DEBUG   ] summary = ERROR
2018-11-30 02:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673173  13 58452  9847685 A  ERRORERROR'
2018-11-30 02:44:07 [DEBUG   ] Got command RPT from MCS: ref #673174
2018-11-30 02:44:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673174  77 58452  9847889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:44:08 [DEBUG   ] Got command RPT from MCS: ref #673175
2018-11-30 02:44:08 [DEBUG   ] summary = ERROR
2018-11-30 02:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673175  13 58452  9848081 A  ERRORERROR'
2018-11-30 02:44:08 [DEBUG   ] Got command RPT from MCS: ref #673177
2018-11-30 02:44:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673177  77 58452  9848285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:44:08 [DEBUG   ] Got command RPT from MCS: ref #673178
2018-11-30 02:44:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673178  12 58452  9848489 A  ERRORB™™š'
2018-11-30 02:44:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:44:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:44:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:45:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:45:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:45:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:45:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:45:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:45:02 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-30 02:45:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:45:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:45:49 [DEBUG   ] Got command RPT from MCS: ref #673187
2018-11-30 02:45:49 [DEBUG   ] summary = ERROR
2018-11-30 02:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673187  13 58452  9949877 A  ERRORERROR'
2018-11-30 02:45:49 [DEBUG   ] Got command RPT from MCS: ref #673188
2018-11-30 02:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673188  77 58452  9949878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:45:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:46:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:46:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:46:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:46:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:46:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:46:02 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-11-30 02:46:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:46:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:46:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:47:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 02:47:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:47:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:47:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:47:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:47:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:47:03 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-11-30 02:47:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:47:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:47:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:48:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:48:02 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-11-30 02:48:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:48:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:48:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:49:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:49:02 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-30 02:49:07 [DEBUG   ] Got command RPT from MCS: ref #673208
2018-11-30 02:49:07 [DEBUG   ] summary = ERROR
2018-11-30 02:49:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673208  13 58452 10147765 A  ERRORERROR'
2018-11-30 02:49:07 [DEBUG   ] Got command RPT from MCS: ref #673209
2018-11-30 02:49:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:49:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673209  77 58452 10147969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:49:08 [DEBUG   ] Got command RPT from MCS: ref #673210
2018-11-30 02:49:08 [DEBUG   ] summary = ERROR
2018-11-30 02:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673210  13 58452 10148173 A  ERRORERROR'
2018-11-30 02:49:08 [DEBUG   ] Got command RPT from MCS: ref #673211
2018-11-30 02:49:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673211  77 58452 10148377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:49:08 [DEBUG   ] Got command RPT from MCS: ref #673212
2018-11-30 02:49:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673212  12 58452 10148569 A  ERRORB™™š'
2018-11-30 02:49:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:49:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:49:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:50:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:50:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:50:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:50:02 [WARNING ] (13, 1, 'bot')
2018-11-30 02:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:50:02 [DEBUG   ] Finished updating board flags in 0.976 seconds
2018-11-30 02:50:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:50:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:50:49 [DEBUG   ] Got command RPT from MCS: ref #673217
2018-11-30 02:50:49 [DEBUG   ] summary = ERROR
2018-11-30 02:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673217  13 58452 10249881 A  ERRORERROR'
2018-11-30 02:50:49 [DEBUG   ] Got command RPT from MCS: ref #673218
2018-11-30 02:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673218  77 58452 10249882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:50:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:51:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:51:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:51:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:51:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:51:03 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-11-30 02:51:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:51:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:51:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:52:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:52:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:52:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:52:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:52:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:52:03 [DEBUG   ] Finished updating board flags in 1.245 seconds
2018-11-30 02:52:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:52:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:52:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:53:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:53:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:53:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:53:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:53:03 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-11-30 02:53:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:53:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:53:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:54:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:54:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:54:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:54:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:54:03 [DEBUG   ] Finished updating board flags in 1.115 seconds
2018-11-30 02:54:07 [DEBUG   ] Got command RPT from MCS: ref #673240
2018-11-30 02:54:07 [DEBUG   ] summary = ERROR
2018-11-30 02:54:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673240  13 58452 10447853 A  ERRORERROR'
2018-11-30 02:54:08 [DEBUG   ] Got command RPT from MCS: ref #673241
2018-11-30 02:54:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673241  77 58452 10448057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:54:08 [DEBUG   ] Got command RPT from MCS: ref #673242
2018-11-30 02:54:08 [DEBUG   ] summary = ERROR
2018-11-30 02:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673242  13 58452 10448261 A  ERRORERROR'
2018-11-30 02:54:08 [DEBUG   ] Got command RPT from MCS: ref #673244
2018-11-30 02:54:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673244  77 58452 10448453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:54:08 [DEBUG   ] Got command RPT from MCS: ref #673245
2018-11-30 02:54:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673245  12 58452 10448657 A  ERRORB™™š'
2018-11-30 02:54:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:54:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:54:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 02:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:55:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 02:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 02:55:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:55:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:55:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:55:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:55:03 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-30 02:55:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:55:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:55:49 [DEBUG   ] Got command RPT from MCS: ref #673250
2018-11-30 02:55:49 [DEBUG   ] summary = ERROR
2018-11-30 02:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673250  13 58452 10549881 A  ERRORERROR'
2018-11-30 02:55:49 [DEBUG   ] Got command RPT from MCS: ref #673251
2018-11-30 02:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673251  77 58452 10549882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:55:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:56:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:56:04 [WARNING ] (13, 1, 'bot')
2018-11-30 02:56:04 [WARNING ] (13, 1, 'bot')
2018-11-30 02:56:04 [WARNING ] (13, 1, 'bot')
2018-11-30 02:56:04 [WARNING ] (13, 1, 'bot')
2018-11-30 02:56:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:56:04 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-11-30 02:56:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:56:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:56:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:57:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:57:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:57:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:57:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:57:03 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-11-30 02:57:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:57:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:57:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:58:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 02:58:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:58:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:58:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:58:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:58:03 [DEBUG   ] Finished updating board flags in 1.299 seconds
2018-11-30 02:58:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:58:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:58:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 02:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 02:59:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:59:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:59:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:59:03 [WARNING ] (13, 1, 'bot')
2018-11-30 02:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 02:59:03 [DEBUG   ] Finished updating board flags in 1.111 seconds
2018-11-30 02:59:07 [DEBUG   ] Got command RPT from MCS: ref #673271
2018-11-30 02:59:07 [DEBUG   ] summary = ERROR
2018-11-30 02:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673271  13 58452 10747945 A  ERRORERROR'
2018-11-30 02:59:08 [DEBUG   ] Got command RPT from MCS: ref #673272
2018-11-30 02:59:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:59:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673272  77 58452 10748137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:59:08 [DEBUG   ] Got command RPT from MCS: ref #673273
2018-11-30 02:59:08 [DEBUG   ] summary = ERROR
2018-11-30 02:59:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673273  13 58452 10748341 A  ERRORERROR'
2018-11-30 02:59:08 [DEBUG   ] Got command RPT from MCS: ref #673274
2018-11-30 02:59:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 02:59:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673274  77 58452 10748545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 02:59:08 [DEBUG   ] Got command RPT from MCS: ref #673275
2018-11-30 02:59:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 02:59:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673275  12 58452 10748749 A  ERRORB˜™š'
2018-11-30 02:59:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:59:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 02:59:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:00:03 [WARNING ] (13, 1, 'bot')
2018-11-30 03:00:03 [WARNING ] (13, 1, 'bot')
2018-11-30 03:00:03 [WARNING ] (13, 1, 'bot')
2018-11-30 03:00:03 [WARNING ] (13, 1, 'bot')
2018-11-30 03:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:00:03 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-30 03:00:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:00:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:00:49 [DEBUG   ] Got command RPT from MCS: ref #673280
2018-11-30 03:00:49 [DEBUG   ] summary = ERROR
2018-11-30 03:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673280  13 58452 10849881 A  ERRORERROR'
2018-11-30 03:00:49 [DEBUG   ] Got command RPT from MCS: ref #673281
2018-11-30 03:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673281  77 58452 10849882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:00:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:01:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:01:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:01:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:01:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:01:04 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-11-30 03:01:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:01:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:01:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:02:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:02:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:02:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:02:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:02:04 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-30 03:02:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:02:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:02:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:03:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:03:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:03:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:03:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:03:04 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-30 03:03:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:03:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:03:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:04:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 03:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:04:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:04:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:04:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:04:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:04:04 [DEBUG   ] Finished updating board flags in 1.121 seconds
2018-11-30 03:04:08 [DEBUG   ] Got command RPT from MCS: ref #673303
2018-11-30 03:04:08 [DEBUG   ] summary = ERROR
2018-11-30 03:04:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673303  13 58452 11048029 A  ERRORERROR'
2018-11-30 03:04:08 [DEBUG   ] Got command RPT from MCS: ref #673304
2018-11-30 03:04:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:04:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673304  77 58452 11048233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:04:08 [DEBUG   ] Got command RPT from MCS: ref #673305
2018-11-30 03:04:08 [DEBUG   ] summary = ERROR
2018-11-30 03:04:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673305  13 58452 11048425 A  ERRORERROR'
2018-11-30 03:04:08 [DEBUG   ] Got command RPT from MCS: ref #673307
2018-11-30 03:04:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:04:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673307  77 58452 11048629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:04:08 [DEBUG   ] Got command RPT from MCS: ref #673308
2018-11-30 03:04:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:04:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673308  12 58452 11048833 A  ERRORB˜™š'
2018-11-30 03:04:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:04:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:04:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 03:05:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:05:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:05:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:05:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:05:04 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-30 03:05:16 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-30 03:05:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:05:49 [DEBUG   ] Got command RPT from MCS: ref #673317
2018-11-30 03:05:49 [DEBUG   ] summary = ERROR
2018-11-30 03:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673317  13 58452 11149885 A  ERRORERROR'
2018-11-30 03:05:49 [DEBUG   ] Got command RPT from MCS: ref #673318
2018-11-30 03:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673318  77 58452 11149886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:05:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:06:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:06:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:06:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:06:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:06:04 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-30 03:06:11 [DEBUG   ] Got command TBW from MCS: ref #673335
2018-11-30 03:06:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-30 03:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   673335   8 58452 11171817 A  ERROR'
2018-11-30 03:06:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-30 03:06:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-30 03:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-30 03:06:14 [DEBUG   ] spawn_process: at 2018-11-30 03:06:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-30 03:06:14 [INFO    ] Finished spawning TBW
2018-11-30 03:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 03:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:07:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:07:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:07:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:07:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:07:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:07:05 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-11-30 03:08:02 [INFO    ] __waitForTBW - TBW finished in 108.844 s
2018-11-30 03:08:03 [DEBUG   ] Finished updating ant stats in 0.393 seconds
2018-11-30 03:08:03 [INFO    ] Started antennas statistics background thread
2018-11-30 03:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 03:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 03:08:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:08:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:08:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:08:04 [WARNING ] (13, 1, 'bot')
2018-11-30 03:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:08:04 [DEBUG   ] Finished updating board flags in 1.073 seconds
2018-11-30 03:08:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:08:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 03:09:04 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2018-11-30 03:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:09:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:09:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:09:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:09:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:09:05 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-11-30 03:09:08 [DEBUG   ] Got command RPT from MCS: ref #673347
2018-11-30 03:09:08 [DEBUG   ] summary = ERROR
2018-11-30 03:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673347  13 58452 11348109 A  ERRORERROR'
2018-11-30 03:09:08 [DEBUG   ] Got command RPT from MCS: ref #673348
2018-11-30 03:09:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673348  77 58452 11348313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:09:08 [DEBUG   ] Got command RPT from MCS: ref #673349
2018-11-30 03:09:08 [DEBUG   ] summary = ERROR
2018-11-30 03:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673349  13 58452 11348517 A  ERRORERROR'
2018-11-30 03:09:08 [DEBUG   ] Got command RPT from MCS: ref #673350
2018-11-30 03:09:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673350  77 58452 11348721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:09:08 [DEBUG   ] Got command RPT from MCS: ref #673351
2018-11-30 03:09:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673351  12 58452 11348913 A  ERRORB™™š'
2018-11-30 03:09:24 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2018-11-30 03:09:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 03:10:04 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2018-11-30 03:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:10:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:10:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:10:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:10:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:10:05 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-30 03:10:24 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-11-30 03:10:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:10:49 [DEBUG   ] Got command RPT from MCS: ref #673352
2018-11-30 03:10:49 [DEBUG   ] summary = ERROR
2018-11-30 03:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673352  13 58452 11449881 A  ERRORERROR'
2018-11-30 03:10:49 [DEBUG   ] Got command RPT from MCS: ref #673353
2018-11-30 03:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673353  77 58452 11449882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:11:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:11:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:11:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:11:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:11:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:11:05 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-30 03:11:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:11:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:12:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 03:12:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:12:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:12:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:12:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:12:05 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-30 03:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:12:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:13:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:13:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:13:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:13:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:13:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:13:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:13:05 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-30 03:13:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:13:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:14:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:14:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:14:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:14:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:14:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:14:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:14:05 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-30 03:14:08 [DEBUG   ] Got command RPT from MCS: ref #673375
2018-11-30 03:14:08 [DEBUG   ] summary = ERROR
2018-11-30 03:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673375  13 58452 11648201 A  ERRORERROR'
2018-11-30 03:14:08 [DEBUG   ] Got command RPT from MCS: ref #673376
2018-11-30 03:14:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673376  77 58452 11648393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:14:08 [DEBUG   ] Got command RPT from MCS: ref #673377
2018-11-30 03:14:08 [DEBUG   ] summary = ERROR
2018-11-30 03:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673377  13 58452 11648597 A  ERRORERROR'
2018-11-30 03:14:08 [DEBUG   ] Got command RPT from MCS: ref #673379
2018-11-30 03:14:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673379  77 58452 11648801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:14:09 [DEBUG   ] Got command RPT from MCS: ref #673381
2018-11-30 03:14:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:14:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673381  12 58452 11649005 A  ERRORB˜™š'
2018-11-30 03:14:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:14:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:15:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 03:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:15:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:15:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:15:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:15:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:15:05 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-11-30 03:15:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:15:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:15:49 [DEBUG   ] Got command RPT from MCS: ref #673389
2018-11-30 03:15:49 [DEBUG   ] summary = ERROR
2018-11-30 03:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673389  13 58452 11749881 A  ERRORERROR'
2018-11-30 03:15:49 [DEBUG   ] Got command RPT from MCS: ref #673390
2018-11-30 03:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673390  77 58452 11749882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:16:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:16:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:16:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:16:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:16:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:16:06 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-30 03:16:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 03:16:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:17:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:17:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:17:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:17:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:17:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:17:06 [DEBUG   ] Finished updating board flags in 1.962 seconds
2018-11-30 03:17:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:17:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:18:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:18:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:18:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:18:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:18:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:18:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:18:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:18:05 [DEBUG   ] Finished updating board flags in 1.257 seconds
2018-11-30 03:18:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:18:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:19:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 03:19:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:19:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:19:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:19:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:19:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:19:05 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-30 03:19:08 [DEBUG   ] Got command RPT from MCS: ref #673410
2018-11-30 03:19:08 [DEBUG   ] summary = ERROR
2018-11-30 03:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673410  13 58452 11948277 A  ERRORERROR'
2018-11-30 03:19:08 [DEBUG   ] Got command RPT from MCS: ref #673411
2018-11-30 03:19:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673411  77 58452 11948481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:19:08 [DEBUG   ] Got command RPT from MCS: ref #673412
2018-11-30 03:19:08 [DEBUG   ] summary = ERROR
2018-11-30 03:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673412  13 58452 11948685 A  ERRORERROR'
2018-11-30 03:19:08 [DEBUG   ] Got command RPT from MCS: ref #673413
2018-11-30 03:19:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:19:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673413  77 58452 11948889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:19:09 [DEBUG   ] Got command RPT from MCS: ref #673414
2018-11-30 03:19:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673414  12 58452 11949081 A  ERRORB™™š'
2018-11-30 03:19:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:19:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:20:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 03:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:20:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:20:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:20:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:20:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:20:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:20:05 [DEBUG   ] Finished updating board flags in 1.146 seconds
2018-11-30 03:20:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:20:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:20:49 [DEBUG   ] Got command RPT from MCS: ref #673419
2018-11-30 03:20:49 [DEBUG   ] summary = ERROR
2018-11-30 03:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673419  13 58452 12049881 A  ERRORERROR'
2018-11-30 03:20:49 [DEBUG   ] Got command RPT from MCS: ref #673420
2018-11-30 03:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673420  77 58452 12049882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:21:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 03:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:21:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:21:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:21:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:21:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:21:05 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-30 03:21:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 03:21:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:22:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:22:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 03:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:22:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:22:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:22:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:22:05 [WARNING ] (13, 1, 'bot')
2018-11-30 03:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:22:05 [DEBUG   ] Finished updating board flags in 0.964 seconds
2018-11-30 03:22:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:22:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:23:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:23:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:23:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:23:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:23:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:23:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-30 03:23:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:23:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 03:24:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:24:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:24:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:24:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:24:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:24:06 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-11-30 03:24:08 [DEBUG   ] Got command RPT from MCS: ref #673442
2018-11-30 03:24:08 [DEBUG   ] summary = ERROR
2018-11-30 03:24:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673442  13 58452 12248369 A  ERRORERROR'
2018-11-30 03:24:08 [DEBUG   ] Got command RPT from MCS: ref #673443
2018-11-30 03:24:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:24:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673443  77 58452 12248561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:24:08 [DEBUG   ] Got command RPT from MCS: ref #673444
2018-11-30 03:24:08 [DEBUG   ] summary = ERROR
2018-11-30 03:24:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673444  13 58452 12248765 A  ERRORERROR'
2018-11-30 03:24:08 [DEBUG   ] Got command RPT from MCS: ref #673446
2018-11-30 03:24:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:24:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673446  77 58452 12248969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:24:09 [DEBUG   ] Got command RPT from MCS: ref #673447
2018-11-30 03:24:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673447  12 58452 12249173 A  ERRORB™™š'
2018-11-30 03:24:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:24:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:25:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:25:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:25:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:25:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:25:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:25:06 [DEBUG   ] Finished updating board flags in 1.224 seconds
2018-11-30 03:25:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 03:25:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:25:49 [DEBUG   ] Got command RPT from MCS: ref #673452
2018-11-30 03:25:49 [DEBUG   ] summary = ERROR
2018-11-30 03:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673452  13 58452 12349889 A  ERRORERROR'
2018-11-30 03:25:49 [DEBUG   ] Got command RPT from MCS: ref #673453
2018-11-30 03:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673453  77 58452 12349890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:26:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:26:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:26:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:26:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:26:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:26:06 [DEBUG   ] Finished updating board flags in 1.170 seconds
2018-11-30 03:26:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 03:26:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:27:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 03:27:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 03:27:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:27:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:27:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:27:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:27:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:27:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:27:06 [DEBUG   ] Finished updating board flags in 1.025 seconds
2018-11-30 03:27:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:27:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:28:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 03:28:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:28:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:28:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:28:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:28:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:28:06 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-30 03:28:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:28:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:29:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 03:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:29:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:29:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:29:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:29:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:29:07 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-11-30 03:29:08 [DEBUG   ] Got command RPT from MCS: ref #673473
2018-11-30 03:29:08 [DEBUG   ] summary = ERROR
2018-11-30 03:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673473  13 58452 12548445 A  ERRORERROR'
2018-11-30 03:29:08 [DEBUG   ] Got command RPT from MCS: ref #673474
2018-11-30 03:29:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673474  77 58452 12548649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:29:08 [DEBUG   ] Got command RPT from MCS: ref #673475
2018-11-30 03:29:08 [DEBUG   ] summary = ERROR
2018-11-30 03:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673475  13 58452 12548853 A  ERRORERROR'
2018-11-30 03:29:09 [DEBUG   ] Got command RPT from MCS: ref #673476
2018-11-30 03:29:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673476  77 58452 12549045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:29:09 [DEBUG   ] Got command RPT from MCS: ref #673477
2018-11-30 03:29:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673477  12 58452 12549249 A  ERRORB˜™š'
2018-11-30 03:29:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:29:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:30:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:30:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:30:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:30:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:30:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:30:07 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-30 03:30:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:30:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 03:30:49 [DEBUG   ] Got command RPT from MCS: ref #673482
2018-11-30 03:30:49 [DEBUG   ] summary = ERROR
2018-11-30 03:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673482  13 58452 12649885 A  ERRORERROR'
2018-11-30 03:30:49 [DEBUG   ] Got command RPT from MCS: ref #673483
2018-11-30 03:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673483  77 58452 12649886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:31:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 03:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 03:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:31:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:31:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:31:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:31:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:31:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:31:06 [DEBUG   ] Finished updating board flags in 1.071 seconds
2018-11-30 03:31:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:31:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:32:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:32:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:32:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:32:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:32:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:32:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:32:06 [DEBUG   ] Finished updating board flags in 1.081 seconds
2018-11-30 03:32:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 03:32:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:33:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:33:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:33:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:33:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:33:06 [WARNING ] (13, 1, 'bot')
2018-11-30 03:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:33:06 [DEBUG   ] Finished updating board flags in 0.906 seconds
2018-11-30 03:33:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:33:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:34:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 03:34:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:34:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:34:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:34:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:34:07 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-11-30 03:34:08 [DEBUG   ] Got command RPT from MCS: ref #673505
2018-11-30 03:34:08 [DEBUG   ] summary = ERROR
2018-11-30 03:34:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673505  13 58452 12848533 A  ERRORERROR'
2018-11-30 03:34:08 [DEBUG   ] Got command RPT from MCS: ref #673506
2018-11-30 03:34:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:34:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673506  77 58452 12848737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:34:08 [DEBUG   ] Got command RPT from MCS: ref #673507
2018-11-30 03:34:08 [DEBUG   ] summary = ERROR
2018-11-30 03:34:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673507  13 58452 12848929 A  ERRORERROR'
2018-11-30 03:34:09 [DEBUG   ] Got command RPT from MCS: ref #673509
2018-11-30 03:34:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673509  77 58452 12849133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:34:09 [DEBUG   ] Got command RPT from MCS: ref #673510
2018-11-30 03:34:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673510  12 58452 12849337 A  ERRORB™™š'
2018-11-30 03:34:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:34:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 03:35:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 03:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:35:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:35:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:35:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:35:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:35:07 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-11-30 03:35:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:35:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:35:49 [DEBUG   ] Got command RPT from MCS: ref #673519
2018-11-30 03:35:49 [DEBUG   ] summary = ERROR
2018-11-30 03:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673519  13 58452 12949885 A  ERRORERROR'
2018-11-30 03:35:49 [DEBUG   ] Got command RPT from MCS: ref #673520
2018-11-30 03:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673520  77 58452 12949886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:36:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:36:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:36:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:36:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:36:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:36:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:36:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:36:07 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-11-30 03:36:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:36:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:37:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 03:37:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:37:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:37:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:37:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:37:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:37:07 [DEBUG   ] Finished updating board flags in 1.076 seconds
2018-11-30 03:37:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 03:37:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:38:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:38:08 [WARNING ] (13, 1, 'bot')
2018-11-30 03:38:08 [WARNING ] (13, 1, 'bot')
2018-11-30 03:38:08 [WARNING ] (13, 1, 'bot')
2018-11-30 03:38:08 [WARNING ] (13, 1, 'bot')
2018-11-30 03:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:38:08 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-30 03:38:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:38:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:39:00 [DEBUG   ] Got command RPT from MCS: ref #673540
2018-11-30 03:39:00 [DEBUG   ] summary = ERROR
2018-11-30 03:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673540  13 58452 13140237 A  ERRORERROR'
2018-11-30 03:39:00 [DEBUG   ] Got command RPT from MCS: ref #673541
2018-11-30 03:39:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673541  77 58452 13140238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:39:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:39:05 [DEBUG   ] Got command INI from MCS: ref #673542
2018-11-30 03:39:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-30 03:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   673542   8 58452 13145254 ABOOTING'
2018-11-30 03:39:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 03:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:39:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:39:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:39:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:39:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:39:07 [WARNING ] (13, 1, 'bot')
2018-11-30 03:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:39:07 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-11-30 03:39:08 [DEBUG   ] Got command RPT from MCS: ref #673543
2018-11-30 03:39:08 [DEBUG   ] summary = ERROR
2018-11-30 03:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673543  13 58452 13148617 A  ERRORERROR'
2018-11-30 03:39:08 [DEBUG   ] Got command RPT from MCS: ref #673544
2018-11-30 03:39:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673544  77 58452 13148817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:39:09 [DEBUG   ] Got command RPT from MCS: ref #673545
2018-11-30 03:39:09 [DEBUG   ] summary = ERROR
2018-11-30 03:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673545  13 58452 13149021 A  ERRORERROR'
2018-11-30 03:39:09 [DEBUG   ] Got command RPT from MCS: ref #673546
2018-11-30 03:39:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673546  77 58452 13149214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:39:09 [DEBUG   ] Got command RPT from MCS: ref #673547
2018-11-30 03:39:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673547  12 58452 13149417 A  ERRORB™™š'
2018-11-30 03:39:25 [INFO    ] -------------------
2018-11-30 03:39:25 [INFO    ]  LWA board status
2018-11-30 03:39:25 [INFO    ] -------------------
2018-11-30 03:39:25 [INFO    ] DP 1: 2 lwa27
2018-11-30 03:39:25 [INFO    ] DP 1: 3 lwa24
2018-11-30 03:39:25 [INFO    ] DP 1: 4 lwa23
2018-11-30 03:39:25 [INFO    ] DP 1: 5 lwa18
2018-11-30 03:39:25 [INFO    ] DP 1: 6 lwa10
2018-11-30 03:39:25 [INFO    ] DP 1: 7 lwa32
2018-11-30 03:39:25 [INFO    ] DP 1: 8 lwa11
2018-11-30 03:39:25 [INFO    ] DP 1: 9 lwa30
2018-11-30 03:39:25 [INFO    ] DP 1: 10 lwa12
2018-11-30 03:39:25 [INFO    ] DP 1: 11 lwa8
2018-11-30 03:39:25 [INFO    ] DP 1: 12 lwa13
2018-11-30 03:39:25 [INFO    ] DP 1: 13 lwa26
2018-11-30 03:39:25 [INFO    ] DP 1: 14 lwa14
2018-11-30 03:39:25 [INFO    ] DP 1: 16 lwa22
2018-11-30 03:39:25 [INFO    ] DP 1: 17 lwa20
2018-11-30 03:39:25 [INFO    ] DP 1: 18 lwa1
2018-11-30 03:39:25 [INFO    ] DP 1: 19 lwa5
2018-11-30 03:39:25 [INFO    ] DP 1: 20 lwa25
2018-11-30 03:39:25 [INFO    ] DP 1: 21 lwa35
2018-11-30 03:39:25 [INFO    ] DP 1: 22 lwa19
2018-11-30 03:39:25 [INFO    ] DP 1: 23 lwa21
2018-11-30 03:39:25 [INFO    ] DP 1: 24 lwa6
2018-11-30 03:39:25 [INFO    ] DP 1: 25 lwa7
2018-11-30 03:39:25 [INFO    ] DP 1: 26 lwa33
2018-11-30 03:39:25 [INFO    ] DP 1: 27 lwa15
2018-11-30 03:39:25 [INFO    ] DP 1: 28 lwa28
2018-11-30 03:39:25 [INFO    ] DP 2: 1 lwa16
2018-11-30 03:39:25 [INFO    ] DP 2: 15 lwa34
2018-11-30 03:39:25 [INFO    ] Total of 28 boards
2018-11-30 03:39:25 [INFO    ] Total of 260 stands
2018-11-30 03:39:25 [INFO    ] -------------------
2018-11-30 03:39:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25139
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25140
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25141
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25142
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25143
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25144
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25145
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25146
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25147
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25148
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25149
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25150
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25151
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25152
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25153
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25154
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25155
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25156
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25157
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25158
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25159
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25160
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25161
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25162
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25163
2018-11-30 03:39:32 [DEBUG   ] 2018-11-30 03:39:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25164
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25139 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25140 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25141 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25142 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25143 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25144 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25145 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25146 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25147 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25148 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25149 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25150 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25151 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25152 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25153 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25154 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25155 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25156 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25157 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25158 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25159 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25160 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25161 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25162 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25163 exited with status 0
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25164 exited with status 0
2018-11-30 03:39:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] spawn_process: at 2018-11-30 03:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25191
2018-11-30 03:39:44 [DEBUG   ] 2018-11-30 03:39:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25192
2018-11-30 03:39:50 [DEBUG   ] 2018-11-30 03:39:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25191 exited with status 0
2018-11-30 03:39:50 [DEBUG   ] 2018-11-30 03:39:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25192 exited with status 0
2018-11-30 03:39:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-30 03:39:50 [DEBUG   ] spawn_process: at 2018-11-30 03:39:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-30 03:39:50 [DEBUG   ] spawn_process: at 2018-11-30 03:39:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-30 03:39:50 [INFO    ] Setting Beam 1 xbars
2018-11-30 03:39:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-30 03:39:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-30 03:39:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-30 03:39:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-30 03:39:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-30 03:39:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-30 03:39:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-30 03:39:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-30 03:39:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-30 03:39:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-30 03:39:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-30 03:39:55 [INFO    ] Setting Beam 2 xbars
2018-11-30 03:39:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-30 03:39:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-30 03:39:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-30 03:39:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-30 03:39:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-30 03:40:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-30 03:40:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-30 03:40:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-30 03:40:01 [INFO    ] Setting Beam 3 xbars
2018-11-30 03:40:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-30 03:40:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-30 03:40:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-30 03:40:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-30 03:40:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-30 03:40:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-30 03:40:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-30 03:40:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-30 03:40:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-30 03:40:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-30 03:40:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-30 03:40:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-30 03:40:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-30 03:40:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-30 03:40:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-30 03:40:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-30 03:40:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-30 03:40:06 [INFO    ] Setting Beam 4 xbars
2018-11-30 03:40:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-30 03:40:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 03:40:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-30 03:40:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-30 03:40:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-30 03:40:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-30 03:40:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-30 03:40:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-30 03:40:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-30 03:40:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-30 03:40:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-30 03:40:12 [INFO    ] All xbars set
2018-11-30 03:40:12 [INFO    ] Setting adder chain routing for all beams
2018-11-30 03:40:17 [INFO    ] Setting beam ids
2018-11-30 03:40:27 [INFO    ] Starting beam delay calibration
2018-11-30 03:40:39 [INFO    ] Beam 1 latency is 6680
2018-11-30 03:40:39 [INFO    ] Beam 2 latency is 5749
2018-11-30 03:40:39 [INFO    ] Beam 3 latency is 5743
2018-11-30 03:40:39 [INFO    ] Beam 4 latency is 6695
2018-11-30 03:40:39 [INFO    ] Stop calibration
2018-11-30 03:40:47 [ERROR   ] Beam delay calibration failed
2018-11-30 03:40:47 [CRITICAL] Calibration failed
2018-11-30 03:40:47 [DEBUG   ] spawn_process: at 2018-11-30 03:40:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-30 03:40:47 [DEBUG   ] spawn_process: at 2018-11-30 03:40:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-30 03:40:47 [DEBUG   ] spawn_process: at 2018-11-30 03:40:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-30 03:40:47 [DEBUG   ] spawn_process: at 2018-11-30 03:40:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-30 03:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-30 03:40:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 03:40:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 291 ms (1543549248.293 s) with PID 26790 and time 1543549249
2018-11-30 03:40:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 03:40:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 380 ms (1543549248.382 s) with PID 26793 and time 1543549249
2018-11-30 03:40:49 [DEBUG   ] Finished updating ant stats in 0.865 seconds
2018-11-30 03:40:49 [INFO    ] Started antennas statistics background thread
2018-11-30 03:40:49 [INFO    ] Started board flags background thread
2018-11-30 03:40:49 [INFO    ] Started BAM background thread
2018-11-30 03:40:49 [INFO    ] Finished the INI process (ref. #673542) in 104.252 s
2018-11-30 03:40:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:40:49 [DEBUG   ] Got command RPT from MCS: ref #673548
2018-11-30 03:40:49 [DEBUG   ] summary = ERROR
2018-11-30 03:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673548  13 58452 13249893 A  ERRORERROR'
2018-11-30 03:40:49 [DEBUG   ] Got command RPT from MCS: ref #673549
2018-11-30 03:40:49 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2018-11-30 03:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673549  72 58452 13249894 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2018-11-30 03:40:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:40:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:40:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:40:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:40:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-30 03:40:50 [DEBUG   ] Finished updating board flags in 1.066 seconds
2018-11-30 03:41:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:41:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:41:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:41:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:41:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:41:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:41:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:41:50 [WARNING ] (13, 1, 'bot')
2018-11-30 03:41:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-30 03:41:50 [DEBUG   ] Finished updating board flags in 1.113 seconds
2018-11-30 03:42:05 [DEBUG   ] Got command RPT from MCS: ref #673569
2018-11-30 03:42:05 [DEBUG   ] summary = ERROR
2018-11-30 03:42:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673569  13 58452 13325249 A  ERRORERROR'
2018-11-30 03:42:05 [DEBUG   ] Got command RPT from MCS: ref #673570
2018-11-30 03:42:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:42:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673570  98 58452 13325250 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:42:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:42:10 [DEBUG   ] Got command INI from MCS: ref #673571
2018-11-30 03:42:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-30 03:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   673571   8 58452 13330258 ABOOTING'
2018-11-30 03:42:30 [INFO    ] -------------------
2018-11-30 03:42:30 [INFO    ]  LWA board status
2018-11-30 03:42:30 [INFO    ] -------------------
2018-11-30 03:42:30 [INFO    ] DP 1: 2 lwa27
2018-11-30 03:42:30 [INFO    ] DP 1: 3 lwa24
2018-11-30 03:42:30 [INFO    ] DP 1: 4 lwa23
2018-11-30 03:42:30 [INFO    ] DP 1: 5 lwa18
2018-11-30 03:42:30 [INFO    ] DP 1: 6 lwa10
2018-11-30 03:42:30 [INFO    ] DP 1: 7 lwa32
2018-11-30 03:42:30 [INFO    ] DP 1: 8 lwa11
2018-11-30 03:42:30 [INFO    ] DP 1: 9 lwa30
2018-11-30 03:42:30 [INFO    ] DP 1: 10 lwa12
2018-11-30 03:42:30 [INFO    ] DP 1: 11 lwa8
2018-11-30 03:42:30 [INFO    ] DP 1: 12 lwa13
2018-11-30 03:42:30 [INFO    ] DP 1: 13 lwa26
2018-11-30 03:42:30 [INFO    ] DP 1: 14 lwa14
2018-11-30 03:42:30 [INFO    ] DP 1: 16 lwa22
2018-11-30 03:42:30 [INFO    ] DP 1: 17 lwa20
2018-11-30 03:42:30 [INFO    ] DP 1: 18 lwa1
2018-11-30 03:42:30 [INFO    ] DP 1: 19 lwa5
2018-11-30 03:42:30 [INFO    ] DP 1: 20 lwa25
2018-11-30 03:42:30 [INFO    ] DP 1: 21 lwa35
2018-11-30 03:42:30 [INFO    ] DP 1: 22 lwa19
2018-11-30 03:42:30 [INFO    ] DP 1: 23 lwa21
2018-11-30 03:42:30 [INFO    ] DP 1: 24 lwa6
2018-11-30 03:42:30 [INFO    ] DP 1: 25 lwa7
2018-11-30 03:42:30 [INFO    ] DP 1: 26 lwa33
2018-11-30 03:42:30 [INFO    ] DP 1: 27 lwa15
2018-11-30 03:42:30 [INFO    ] DP 1: 28 lwa28
2018-11-30 03:42:30 [INFO    ] DP 2: 1 lwa16
2018-11-30 03:42:30 [INFO    ] DP 2: 15 lwa34
2018-11-30 03:42:30 [INFO    ] Total of 28 boards
2018-11-30 03:42:30 [INFO    ] Total of 260 stands
2018-11-30 03:42:30 [INFO    ] -------------------
2018-11-30 03:42:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27344
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27345
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27346
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27347
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27348
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27349
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27350
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27351
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27352
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27353
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27354
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27355
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27356
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27357
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27358
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27359
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27360
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27361
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27362
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27363
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27364
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27365
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27366
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27367
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27368
2018-11-30 03:42:37 [DEBUG   ] 2018-11-30 03:42:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27369
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27344 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27345 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27346 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27347 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27348 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27349 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27350 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27351 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27352 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27353 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27354 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27355 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27356 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27357 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27358 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27359 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27360 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27361 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27362 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27363 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27364 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27365 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27366 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27367 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27368 exited with status 0
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27369 exited with status 0
2018-11-30 03:42:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] spawn_process: at 2018-11-30 03:42:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27396
2018-11-30 03:42:49 [DEBUG   ] 2018-11-30 03:42:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27397
2018-11-30 03:42:55 [DEBUG   ] 2018-11-30 03:42:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27396 exited with status 0
2018-11-30 03:42:55 [DEBUG   ] 2018-11-30 03:42:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27397 exited with status 0
2018-11-30 03:42:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-30 03:42:55 [DEBUG   ] spawn_process: at 2018-11-30 03:42:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-30 03:42:55 [DEBUG   ] spawn_process: at 2018-11-30 03:42:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-30 03:42:55 [INFO    ] Setting Beam 1 xbars
2018-11-30 03:42:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-30 03:42:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-30 03:42:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-30 03:42:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-30 03:42:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-30 03:42:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-30 03:42:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-30 03:42:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-30 03:42:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-30 03:43:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-30 03:43:00 [INFO    ] Setting Beam 2 xbars
2018-11-30 03:43:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-30 03:43:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-30 03:43:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-30 03:43:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-30 03:43:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-30 03:43:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-30 03:43:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-30 03:43:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-30 03:43:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-30 03:43:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-30 03:43:06 [INFO    ] Setting Beam 3 xbars
2018-11-30 03:43:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-30 03:43:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-30 03:43:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-30 03:43:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-30 03:43:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-30 03:43:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-30 03:43:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-30 03:43:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-30 03:43:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-30 03:43:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-30 03:43:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-30 03:43:11 [INFO    ] Setting Beam 4 xbars
2018-11-30 03:43:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-30 03:43:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-30 03:43:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-30 03:43:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-30 03:43:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-30 03:43:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-30 03:43:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-30 03:43:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-30 03:43:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-30 03:43:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-30 03:43:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-30 03:43:17 [INFO    ] All xbars set
2018-11-30 03:43:17 [INFO    ] Setting adder chain routing for all beams
2018-11-30 03:43:22 [INFO    ] Setting beam ids
2018-11-30 03:43:32 [INFO    ] Starting beam delay calibration
2018-11-30 03:43:44 [INFO    ] Beam 1 latency is 5725
2018-11-30 03:43:44 [INFO    ] Beam 2 latency is 6704
2018-11-30 03:43:44 [INFO    ] Beam 3 latency is 6686
2018-11-30 03:43:44 [INFO    ] Beam 4 latency is 6675
2018-11-30 03:43:44 [INFO    ] Stop calibration
2018-11-30 03:43:52 [ERROR   ] Beam delay calibration failed
2018-11-30 03:43:52 [CRITICAL] Calibration failed
2018-11-30 03:43:52 [DEBUG   ] spawn_process: at 2018-11-30 03:43:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-30 03:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-30 03:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-30 03:43:52 [DEBUG   ] spawn_process: at 2018-11-30 03:43:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-30 03:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-30 03:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-30 03:43:52 [DEBUG   ] spawn_process: at 2018-11-30 03:43:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-30 03:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-30 03:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-30 03:43:53 [DEBUG   ] spawn_process: at 2018-11-30 03:43:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-30 03:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-30 03:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-30 03:43:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-30 03:43:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 269 ms (1543549433.271 s) with PID 28959 and time 1543549434
2018-11-30 03:43:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 03:43:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 372 ms (1543549433.374 s) with PID 28962 and time 1543549434
2018-11-30 03:43:54 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2018-11-30 03:43:54 [INFO    ] Started antennas statistics background thread
2018-11-30 03:43:54 [INFO    ] Started board flags background thread
2018-11-30 03:43:54 [INFO    ] Started BAM background thread
2018-11-30 03:43:54 [INFO    ] Finished the INI process (ref. #673571) in 104.240 s
2018-11-30 03:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:43:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:43:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:43:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:43:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:43:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-30 03:43:55 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-11-30 03:44:08 [DEBUG   ] Got command RPT from MCS: ref #673574
2018-11-30 03:44:08 [DEBUG   ] summary = ERROR
2018-11-30 03:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673574  13 58452 13448697 A  ERRORERROR'
2018-11-30 03:44:08 [DEBUG   ] Got command RPT from MCS: ref #673575
2018-11-30 03:44:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:44:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673575  98 58452 13448911 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:44:09 [DEBUG   ] Got command RPT from MCS: ref #673576
2018-11-30 03:44:09 [DEBUG   ] summary = ERROR
2018-11-30 03:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673576  13 58452 13449101 A  ERRORERROR'
2018-11-30 03:44:09 [DEBUG   ] Got command RPT from MCS: ref #673578
2018-11-30 03:44:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673578  98 58452 13449305 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:44:09 [DEBUG   ] Got command RPT from MCS: ref #673579
2018-11-30 03:44:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673579  12 58452 13449509 A  ERRORB—™š'
2018-11-30 03:44:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 03:44:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:44:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:44:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:44:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:44:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:44:55 [WARNING ] (13, 1, 'bot')
2018-11-30 03:44:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-30 03:44:55 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-30 03:45:10 [DEBUG   ] Got command RPT from MCS: ref #673588
2018-11-30 03:45:10 [DEBUG   ] summary = ERROR
2018-11-30 03:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673588  13 58452 13510257 A  ERRORERROR'
2018-11-30 03:45:10 [DEBUG   ] Got command RPT from MCS: ref #673589
2018-11-30 03:45:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673589  98 58452 13510258 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:45:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:45:15 [DEBUG   ] Got command INI from MCS: ref #673590
2018-11-30 03:45:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-30 03:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   673590   8 58452 13515262 ABOOTING'
2018-11-30 03:45:35 [INFO    ] -------------------
2018-11-30 03:45:35 [INFO    ]  LWA board status
2018-11-30 03:45:35 [INFO    ] -------------------
2018-11-30 03:45:35 [INFO    ] DP 1: 2 lwa27
2018-11-30 03:45:35 [INFO    ] DP 1: 3 lwa24
2018-11-30 03:45:35 [INFO    ] DP 1: 4 lwa23
2018-11-30 03:45:35 [INFO    ] DP 1: 5 lwa18
2018-11-30 03:45:35 [INFO    ] DP 1: 6 lwa10
2018-11-30 03:45:35 [INFO    ] DP 1: 7 lwa32
2018-11-30 03:45:35 [INFO    ] DP 1: 8 lwa11
2018-11-30 03:45:35 [INFO    ] DP 1: 9 lwa30
2018-11-30 03:45:35 [INFO    ] DP 1: 10 lwa12
2018-11-30 03:45:35 [INFO    ] DP 1: 11 lwa8
2018-11-30 03:45:35 [INFO    ] DP 1: 12 lwa13
2018-11-30 03:45:35 [INFO    ] DP 1: 13 lwa26
2018-11-30 03:45:35 [INFO    ] DP 1: 14 lwa14
2018-11-30 03:45:35 [INFO    ] DP 1: 16 lwa22
2018-11-30 03:45:35 [INFO    ] DP 1: 17 lwa20
2018-11-30 03:45:35 [INFO    ] DP 1: 18 lwa1
2018-11-30 03:45:35 [INFO    ] DP 1: 19 lwa5
2018-11-30 03:45:35 [INFO    ] DP 1: 20 lwa25
2018-11-30 03:45:35 [INFO    ] DP 1: 21 lwa35
2018-11-30 03:45:35 [INFO    ] DP 1: 22 lwa19
2018-11-30 03:45:35 [INFO    ] DP 1: 23 lwa21
2018-11-30 03:45:35 [INFO    ] DP 1: 24 lwa6
2018-11-30 03:45:35 [INFO    ] DP 1: 25 lwa7
2018-11-30 03:45:35 [INFO    ] DP 1: 26 lwa33
2018-11-30 03:45:35 [INFO    ] DP 1: 27 lwa15
2018-11-30 03:45:35 [INFO    ] DP 1: 28 lwa28
2018-11-30 03:45:35 [INFO    ] DP 2: 1 lwa16
2018-11-30 03:45:35 [INFO    ] DP 2: 15 lwa34
2018-11-30 03:45:35 [INFO    ] Total of 28 boards
2018-11-30 03:45:35 [INFO    ] Total of 260 stands
2018-11-30 03:45:35 [INFO    ] -------------------
2018-11-30 03:45:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29518
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29519
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29520
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29521
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29522
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29523
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29524
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29525
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29526
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29527
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29528
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29529
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29530
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29531
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29532
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29533
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29534
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29535
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29536
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29537
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29538
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29539
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29540
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29541
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29542
2018-11-30 03:45:42 [DEBUG   ] 2018-11-30 03:45:42 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29543
2018-11-30 03:45:49 [DEBUG   ] Got command RPT from MCS: ref #673591
2018-11-30 03:45:49 [DEBUG   ] summary = BOOTING
2018-11-30 03:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673591  15 58452 13549885 ABOOTINGBOOTING'
2018-11-30 03:45:49 [DEBUG   ] Got command RPT from MCS: ref #673592
2018-11-30 03:45:49 [DEBUG   ] info = Running INI sequence
2018-11-30 03:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673592  28 58452 13549886 ABOOTINGRunning INI sequence'
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29518 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29519 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29520 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29521 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29522 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29523 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29524 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29525 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29526 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29527 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29528 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29529 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29530 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29531 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29532 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29533 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29534 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29535 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29536 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29537 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29538 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29539 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29540 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29541 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29542 exited with status 0
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29543 exited with status 0
2018-11-30 03:45:54 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] spawn_process: at 2018-11-30 03:45:54 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29570
2018-11-30 03:45:54 [DEBUG   ] 2018-11-30 03:45:54 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29571
2018-11-30 03:46:00 [DEBUG   ] 2018-11-30 03:46:00 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29570 exited with status 0
2018-11-30 03:46:00 [DEBUG   ] 2018-11-30 03:46:00 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29571 exited with status 0
2018-11-30 03:46:00 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-30 03:46:00 [DEBUG   ] spawn_process: at 2018-11-30 03:46:00 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-30 03:46:00 [DEBUG   ] spawn_process: at 2018-11-30 03:46:00 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-30 03:46:00 [INFO    ] Setting Beam 1 xbars
2018-11-30 03:46:00 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-30 03:46:00 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-30 03:46:00 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-30 03:46:00 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-30 03:46:00 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-30 03:46:01 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-30 03:46:02 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-30 03:46:03 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-30 03:46:03 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-30 03:46:04 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-30 03:46:05 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-30 03:46:05 [INFO    ] Setting Beam 2 xbars
2018-11-30 03:46:05 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-30 03:46:06 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-30 03:46:07 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-30 03:46:08 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-30 03:46:09 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-30 03:46:10 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-30 03:46:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-30 03:46:11 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-30 03:46:11 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-30 03:46:11 [INFO    ] Setting Beam 3 xbars
2018-11-30 03:46:11 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-30 03:46:11 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-30 03:46:11 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-30 03:46:11 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-30 03:46:11 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-30 03:46:11 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-30 03:46:11 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-30 03:46:12 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-30 03:46:13 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-30 03:46:14 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-30 03:46:15 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-30 03:46:16 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-30 03:46:16 [INFO    ] Setting Beam 4 xbars
2018-11-30 03:46:16 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-30 03:46:16 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-30 03:46:17 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-30 03:46:18 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-30 03:46:19 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-30 03:46:20 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-30 03:46:21 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-30 03:46:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-30 03:46:22 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-30 03:46:22 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-30 03:46:22 [INFO    ] All xbars set
2018-11-30 03:46:22 [INFO    ] Setting adder chain routing for all beams
2018-11-30 03:46:27 [INFO    ] Setting beam ids
2018-11-30 03:46:37 [INFO    ] Starting beam delay calibration
2018-11-30 03:46:49 [INFO    ] Beam 1 latency is 5726
2018-11-30 03:46:49 [INFO    ] Beam 2 latency is 5750
2018-11-30 03:46:49 [INFO    ] Beam 3 latency is 5726
2018-11-30 03:46:49 [INFO    ] Beam 4 latency is 5732
2018-11-30 03:46:49 [INFO    ] Stop calibration
2018-11-30 03:46:57 [INFO    ] Beam delay calibration successful
2018-11-30 03:46:57 [INFO    ] Calibration passed
2018-11-30 03:46:57 [DEBUG   ] spawn_process: at 2018-11-30 03:46:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-30 03:46:57 [DEBUG   ] spawn_process: at 2018-11-30 03:46:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-30 03:46:57 [DEBUG   ] spawn_process: at 2018-11-30 03:46:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-30 03:46:57 [DEBUG   ] spawn_process: at 2018-11-30 03:46:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-30 03:46:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-30 03:46:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 03:46:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 286 ms (1543549618.288 s) with PID 31151 and time 1543549619
2018-11-30 03:46:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 03:46:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 376 ms (1543549618.378 s) with PID 31154 and time 1543549619
2018-11-30 03:46:59 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2018-11-30 03:46:59 [INFO    ] Started antennas statistics background thread
2018-11-30 03:46:59 [INFO    ] Started board flags background thread
2018-11-30 03:46:59 [INFO    ] Started BAM background thread
2018-11-30 03:46:59 [INFO    ] Finished the INI process (ref. #673590) in 104.242 s
2018-11-30 03:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 03:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:47:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:47:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:47:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:47:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:47:00 [DEBUG   ] Finished updating board flags in 1.056 seconds
2018-11-30 03:47:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:47:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:47:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:48:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:48:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:48:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:48:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:48:00 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-30 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #673612
2018-11-30 03:48:15 [DEBUG   ] summary = ERROR
2018-11-30 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673612  13 58452 13695265 A  ERRORERROR'
2018-11-30 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #673613
2018-11-30 03:48:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673613  77 58452 13695266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:48:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:48:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:48:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:49:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:49:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:49:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:49:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:49:00 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-11-30 03:49:08 [DEBUG   ] Got command RPT from MCS: ref #673614
2018-11-30 03:49:08 [DEBUG   ] summary = ERROR
2018-11-30 03:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673614  13 58452 13748785 A  ERRORERROR'
2018-11-30 03:49:08 [DEBUG   ] Got command RPT from MCS: ref #673615
2018-11-30 03:49:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:49:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673615  77 58452 13748989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:49:09 [DEBUG   ] Got command RPT from MCS: ref #673616
2018-11-30 03:49:09 [DEBUG   ] summary = ERROR
2018-11-30 03:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673616  13 58452 13749193 A  ERRORERROR'
2018-11-30 03:49:09 [DEBUG   ] Got command RPT from MCS: ref #673617
2018-11-30 03:49:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673617  77 58452 13749385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:49:09 [DEBUG   ] Got command RPT from MCS: ref #673618
2018-11-30 03:49:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673618  12 58452 13749589 A  ERRORB˜™š'
2018-11-30 03:49:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:49:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:49:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 03:50:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:50:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:50:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:50:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:50:01 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-11-30 03:50:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:50:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:50:49 [DEBUG   ] Got command RPT from MCS: ref #673623
2018-11-30 03:50:49 [DEBUG   ] summary = ERROR
2018-11-30 03:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673623  13 58452 13849897 A  ERRORERROR'
2018-11-30 03:50:49 [DEBUG   ] Got command RPT from MCS: ref #673624
2018-11-30 03:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673624  77 58452 13849898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:50:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 03:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:51:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 03:51:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:51:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:51:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:51:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:51:01 [DEBUG   ] Finished updating board flags in 1.907 seconds
2018-11-30 03:51:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:51:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:51:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:52:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 03:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:52:00 [DEBUG   ] Finished updating board flags in 1.262 seconds
2018-11-30 03:52:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:52:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:52:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:53:00 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-11-30 03:53:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:53:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:53:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:54:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:54:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:54:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:54:00 [WARNING ] (13, 1, 'bot')
2018-11-30 03:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:54:00 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-30 03:54:08 [DEBUG   ] Got command RPT from MCS: ref #673646
2018-11-30 03:54:08 [DEBUG   ] summary = ERROR
2018-11-30 03:54:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673646  13 58452 14048873 A  ERRORERROR'
2018-11-30 03:54:09 [DEBUG   ] Got command RPT from MCS: ref #673647
2018-11-30 03:54:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673647  77 58452 14049077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:54:09 [DEBUG   ] Got command RPT from MCS: ref #673648
2018-11-30 03:54:09 [DEBUG   ] summary = ERROR
2018-11-30 03:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673648  13 58452 14049269 A  ERRORERROR'
2018-11-30 03:54:09 [DEBUG   ] Got command RPT from MCS: ref #673650
2018-11-30 03:54:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673650  77 58452 14049473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:54:09 [DEBUG   ] Got command RPT from MCS: ref #673652
2018-11-30 03:54:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673652  12 58452 14049677 A  ERRORB˜™š'
2018-11-30 03:54:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:54:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:54:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 03:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:55:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:55:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:55:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:55:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:55:01 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-30 03:55:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 03:55:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:55:49 [DEBUG   ] Got command RPT from MCS: ref #673656
2018-11-30 03:55:49 [DEBUG   ] summary = ERROR
2018-11-30 03:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673656  13 58452 14149897 A  ERRORERROR'
2018-11-30 03:55:49 [DEBUG   ] Got command RPT from MCS: ref #673657
2018-11-30 03:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673657  77 58452 14149898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:55:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:56:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:56:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:56:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:56:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:56:01 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-11-30 03:56:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:56:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:56:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 03:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:57:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:57:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:57:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:57:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:57:01 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-30 03:57:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 03:57:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:57:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:58:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:58:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:58:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:58:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:58:01 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-30 03:58:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:58:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:58:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 03:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 03:59:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:59:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:59:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:59:01 [WARNING ] (13, 1, 'bot')
2018-11-30 03:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 03:59:01 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-30 03:59:08 [DEBUG   ] Got command RPT from MCS: ref #673677
2018-11-30 03:59:08 [DEBUG   ] summary = ERROR
2018-11-30 03:59:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673677  13 58452 14348957 A  ERRORERROR'
2018-11-30 03:59:09 [DEBUG   ] Got command RPT from MCS: ref #673678
2018-11-30 03:59:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673678  77 58452 14349161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:59:09 [DEBUG   ] Got command RPT from MCS: ref #673679
2018-11-30 03:59:09 [DEBUG   ] summary = ERROR
2018-11-30 03:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673679  13 58452 14349365 A  ERRORERROR'
2018-11-30 03:59:09 [DEBUG   ] Got command RPT from MCS: ref #673680
2018-11-30 03:59:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 03:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673680  77 58452 14349557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 03:59:09 [DEBUG   ] Got command RPT from MCS: ref #673681
2018-11-30 03:59:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 03:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673681  12 58452 14349761 A  ERRORB™™š'
2018-11-30 03:59:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 03:59:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 03:59:58 [DEBUG   ] Got command DRX from MCS: ref #673688
2018-11-30 03:59:58 [INFO    ] sending drx command to lwa16
2018-11-30 03:59:58 [DEBUG   ] run_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 60000000.0 7 9 0']
2018-11-30 03:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-30 03:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   673688   8 58452 14398009 A  ERROR'
2018-11-30 03:59:58 [DEBUG   ] Got command DRX from MCS: ref #673689
2018-11-30 03:59:58 [INFO    ] sending drx command to lwa16
2018-11-30 03:59:58 [DEBUG   ] run_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 76000000.0 7 9 0']
2018-11-30 03:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-30 03:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   673689   8 58452 14398013 A  ERROR'
2018-11-30 03:59:58 [DEBUG   ] Got command BAM from MCS: ref #673690
2018-11-30 03:59:58 [INFO    ] Finished processing BAM request
2018-11-30 03:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 03:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673690   8 58452 14398029 A  ERROR'
2018-11-30 03:59:58 [INFO    ] Finished starting DRX
2018-11-30 03:59:58 [INFO    ] Finished starting DRX
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 03:59:58 [DEBUG   ] spawn_process: at 2018-11-30 03:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:00:00 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 04:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:00:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:00:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:00:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:00:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:00:01 [DEBUG   ] Finished updating board flags in 1.238 seconds
2018-11-30 04:00:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 04:00:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:00:47 [DEBUG   ] Got command BAM from MCS: ref #673692
2018-11-30 04:00:47 [INFO    ] Finished processing BAM request
2018-11-30 04:00:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:00:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673692   8 58452 14447025 A  ERROR'
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:00:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:00:47 [DEBUG   ] spawn_process: at 2018-11-30 04:00:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:00:49 [DEBUG   ] Got command RPT from MCS: ref #673693
2018-11-30 04:00:49 [DEBUG   ] summary = ERROR
2018-11-30 04:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673693  13 58452 14449897 A  ERRORERROR'
2018-11-30 04:00:49 [DEBUG   ] Got command RPT from MCS: ref #673694
2018-11-30 04:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673694  77 58452 14449898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:01:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:01:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:01:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:01:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:01:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:01:01 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-11-30 04:01:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:01:36 [DEBUG   ] Got command BAM from MCS: ref #673710
2018-11-30 04:01:36 [INFO    ] Finished processing BAM request
2018-11-30 04:01:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673710   8 58452 14496033 A  ERROR'
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:01:36 [DEBUG   ] spawn_process: at 2018-11-30 04:01:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:01:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:02:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 04:02:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 04:02:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:02:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:02:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:02:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:02:01 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-30 04:02:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:02:25 [DEBUG   ] Got command BAM from MCS: ref #673715
2018-11-30 04:02:25 [INFO    ] Finished processing BAM request
2018-11-30 04:02:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673715   8 58452 14545025 A  ERROR'
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:02:25 [DEBUG   ] spawn_process: at 2018-11-30 04:02:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:02:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:03:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:03:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:03:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:03:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:03:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:03:02 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-11-30 04:03:14 [DEBUG   ] Got command BAM from MCS: ref #673716
2018-11-30 04:03:14 [INFO    ] Finished processing BAM request
2018-11-30 04:03:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673716   8 58452 14594037 A  ERROR'
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:03:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:03:15 [DEBUG   ] spawn_process: at 2018-11-30 04:03:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:03:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:03:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:04:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:04:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:04:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:04:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:04:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:04:02 [DEBUG   ] Finished updating board flags in 1.941 seconds
2018-11-30 04:04:03 [DEBUG   ] Got command BAM from MCS: ref #673719
2018-11-30 04:04:03 [INFO    ] Finished processing BAM request
2018-11-30 04:04:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673719   8 58452 14643025 A  ERROR'
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:04:03 [DEBUG   ] spawn_process: at 2018-11-30 04:04:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:04:09 [DEBUG   ] Got command RPT from MCS: ref #673720
2018-11-30 04:04:09 [DEBUG   ] summary = ERROR
2018-11-30 04:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673720  13 58452 14649037 A  ERRORERROR'
2018-11-30 04:04:09 [DEBUG   ] Got command RPT from MCS: ref #673721
2018-11-30 04:04:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673721  77 58452 14649241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:04:09 [DEBUG   ] Got command RPT from MCS: ref #673722
2018-11-30 04:04:09 [DEBUG   ] summary = ERROR
2018-11-30 04:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673722  13 58452 14649445 A  ERRORERROR'
2018-11-30 04:04:09 [DEBUG   ] Got command RPT from MCS: ref #673724
2018-11-30 04:04:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673724  77 58452 14649649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:04:09 [DEBUG   ] Got command RPT from MCS: ref #673725
2018-11-30 04:04:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:04:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673725  12 58452 14649841 A  ERRORBžff'
2018-11-30 04:04:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:04:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:04:51 [DEBUG   ] Got command BAM from MCS: ref #673730
2018-11-30 04:04:51 [INFO    ] Finished processing BAM request
2018-11-30 04:04:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673730   8 58452 14691029 A  ERROR'
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:04:51 [DEBUG   ] spawn_process: at 2018-11-30 04:04:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:05:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-30 04:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 04:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:05:01 [DEBUG   ] Finished updating board flags in 1.252 seconds
2018-11-30 04:05:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:05:39 [DEBUG   ] Got command BAM from MCS: ref #673735
2018-11-30 04:05:39 [INFO    ] Finished processing BAM request
2018-11-30 04:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673735   8 58452 14739029 A  ERROR'
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:05:39 [DEBUG   ] spawn_process: at 2018-11-30 04:05:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:05:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:05:49 [DEBUG   ] Got command RPT from MCS: ref #673736
2018-11-30 04:05:49 [DEBUG   ] summary = ERROR
2018-11-30 04:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673736  13 58452 14749897 A  ERRORERROR'
2018-11-30 04:05:49 [DEBUG   ] Got command RPT from MCS: ref #673737
2018-11-30 04:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673737  77 58452 14749898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:06:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:06:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:06:01 [DEBUG   ] Finished updating board flags in 1.251 seconds
2018-11-30 04:06:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:06:27 [DEBUG   ] Got command BAM from MCS: ref #673753
2018-11-30 04:06:27 [INFO    ] Finished processing BAM request
2018-11-30 04:06:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673753   8 58452 14787029 A  ERROR'
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:06:27 [DEBUG   ] spawn_process: at 2018-11-30 04:06:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:06:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:07:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:07:01 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-30 04:07:15 [DEBUG   ] Got command BAM from MCS: ref #673754
2018-11-30 04:07:15 [INFO    ] Finished processing BAM request
2018-11-30 04:07:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673754   8 58452 14835033 A  ERROR'
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:07:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:07:15 [DEBUG   ] spawn_process: at 2018-11-30 04:07:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:07:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:07:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:08:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:08:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:08:01 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-30 04:08:03 [DEBUG   ] Got command BAM from MCS: ref #673755
2018-11-30 04:08:03 [INFO    ] Finished processing BAM request
2018-11-30 04:08:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673755   8 58452 14883029 A  ERROR'
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:08:03 [DEBUG   ] spawn_process: at 2018-11-30 04:08:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:08:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:08:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:08:51 [DEBUG   ] Got command BAM from MCS: ref #673760
2018-11-30 04:08:51 [INFO    ] Finished processing BAM request
2018-11-30 04:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673760   8 58452 14931025 A  ERROR'
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:08:51 [DEBUG   ] spawn_process: at 2018-11-30 04:08:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:09:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 04:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:09:01 [DEBUG   ] Finished updating board flags in 0.959 seconds
2018-11-30 04:09:09 [DEBUG   ] Got command RPT from MCS: ref #673761
2018-11-30 04:09:09 [DEBUG   ] summary = ERROR
2018-11-30 04:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673761  13 58452 14949129 A  ERRORERROR'
2018-11-30 04:09:09 [DEBUG   ] Got command RPT from MCS: ref #673762
2018-11-30 04:09:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673762  77 58452 14949333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:09:09 [DEBUG   ] Got command RPT from MCS: ref #673763
2018-11-30 04:09:09 [DEBUG   ] summary = ERROR
2018-11-30 04:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673763  13 58452 14949525 A  ERRORERROR'
2018-11-30 04:09:09 [DEBUG   ] Got command RPT from MCS: ref #673764
2018-11-30 04:09:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673764  77 58452 14949729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:09:09 [DEBUG   ] Got command RPT from MCS: ref #673765
2018-11-30 04:09:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673765  12 58452 14949933 A  ERRORB�ff'
2018-11-30 04:09:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:09:39 [DEBUG   ] Got command BAM from MCS: ref #673766
2018-11-30 04:09:39 [INFO    ] Finished processing BAM request
2018-11-30 04:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673766   8 58452 14979029 A  ERROR'
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:09:39 [DEBUG   ] spawn_process: at 2018-11-30 04:09:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:09:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:10:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 04:10:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:10:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:10:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:10:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:10:02 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-30 04:10:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:10:27 [DEBUG   ] Got command BAM from MCS: ref #673767
2018-11-30 04:10:27 [INFO    ] Finished processing BAM request
2018-11-30 04:10:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673767   8 58452 15027025 A  ERROR'
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:10:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:10:27 [DEBUG   ] spawn_process: at 2018-11-30 04:10:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:10:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:10:49 [DEBUG   ] Got command RPT from MCS: ref #673768
2018-11-30 04:10:49 [DEBUG   ] summary = ERROR
2018-11-30 04:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673768  13 58452 15049893 A  ERRORERROR'
2018-11-30 04:10:49 [DEBUG   ] Got command RPT from MCS: ref #673769
2018-11-30 04:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673769  77 58452 15049894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:11:00 [DEBUG   ] Finished updating ant stats in 0.578 seconds
2018-11-30 04:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 04:11:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:11:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:11:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:11:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:11:02 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-30 04:11:15 [DEBUG   ] Got command BAM from MCS: ref #673785
2018-11-30 04:11:15 [INFO    ] Finished processing BAM request
2018-11-30 04:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673785   8 58452 15075029 A  ERROR'
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:11:15 [DEBUG   ] spawn_process: at 2018-11-30 04:11:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:11:21 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-30 04:11:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:12:01 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 04:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:12:02 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-30 04:12:03 [DEBUG   ] Got command BAM from MCS: ref #673790
2018-11-30 04:12:03 [INFO    ] Finished processing BAM request
2018-11-30 04:12:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:12:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673790   8 58452 15123029 A  ERROR'
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:12:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:12:03 [DEBUG   ] spawn_process: at 2018-11-30 04:12:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:12:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:12:41 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-30 04:12:51 [DEBUG   ] Got command BAM from MCS: ref #673791
2018-11-30 04:12:51 [INFO    ] Finished processing BAM request
2018-11-30 04:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673791   8 58452 15171025 A  ERROR'
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:12:51 [DEBUG   ] spawn_process: at 2018-11-30 04:12:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:13:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:13:03 [DEBUG   ] Finished updating board flags in 1.865 seconds
2018-11-30 04:13:21 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-30 04:13:39 [DEBUG   ] Got command BAM from MCS: ref #673792
2018-11-30 04:13:39 [INFO    ] Finished processing BAM request
2018-11-30 04:13:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673792   8 58452 15219025 A  ERROR'
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:13:39 [DEBUG   ] spawn_process: at 2018-11-30 04:13:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:13:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:14:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:14:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:14:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:14:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:14:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:14:02 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-11-30 04:14:09 [DEBUG   ] Got command RPT from MCS: ref #673795
2018-11-30 04:14:09 [DEBUG   ] summary = ERROR
2018-11-30 04:14:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673795  13 58452 15249217 A  ERRORERROR'
2018-11-30 04:14:09 [DEBUG   ] Got command RPT from MCS: ref #673796
2018-11-30 04:14:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:14:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673796  77 58452 15249409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:14:09 [DEBUG   ] Got command RPT from MCS: ref #673797
2018-11-30 04:14:09 [DEBUG   ] summary = ERROR
2018-11-30 04:14:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673797  13 58452 15249613 A  ERRORERROR'
2018-11-30 04:14:09 [DEBUG   ] Got command RPT from MCS: ref #673799
2018-11-30 04:14:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:14:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673799  77 58452 15249817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:14:10 [DEBUG   ] Got command RPT from MCS: ref #673800
2018-11-30 04:14:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673800  12 58452 15250021 A  ERRORBžff'
2018-11-30 04:14:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:14:27 [DEBUG   ] Got command BAM from MCS: ref #673809
2018-11-30 04:14:27 [INFO    ] Finished processing BAM request
2018-11-30 04:14:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673809   8 58452 15267029 A  ERROR'
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:14:27 [DEBUG   ] spawn_process: at 2018-11-30 04:14:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:14:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:15:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:15:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:15:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:15:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:15:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:15:02 [DEBUG   ] Finished updating board flags in 1.031 seconds
2018-11-30 04:15:15 [DEBUG   ] Got command BAM from MCS: ref #673810
2018-11-30 04:15:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673810   8 58452 15315070 A  ERROR'
2018-11-30 04:15:15 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-30 04:15:15 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-30 04:15:15 [INFO    ] Finished processing BAM request
2018-11-30 04:15:15 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-30 04:15:15 [DEBUG   ] 
2018-11-30 04:15:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:15:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:15:49 [DEBUG   ] Got command RPT from MCS: ref #673811
2018-11-30 04:15:49 [DEBUG   ] summary = ERROR
2018-11-30 04:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673811  13 58452 15349901 A  ERRORERROR'
2018-11-30 04:15:49 [DEBUG   ] Got command RPT from MCS: ref #673812
2018-11-30 04:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673812  77 58452 15349902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:16:01 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 04:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:16:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:16:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:16:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:16:02 [WARNING ] (13, 1, 'bot')
2018-11-30 04:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:16:02 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-30 04:16:03 [DEBUG   ] Got command BAM from MCS: ref #673828
2018-11-30 04:16:03 [INFO    ] Finished processing BAM request
2018-11-30 04:16:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:16:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673828   8 58452 15363033 A  ERROR'
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:16:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:16:03 [DEBUG   ] spawn_process: at 2018-11-30 04:16:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:16:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:16:41 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-30 04:16:51 [DEBUG   ] Got command BAM from MCS: ref #673829
2018-11-30 04:16:51 [INFO    ] Finished processing BAM request
2018-11-30 04:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673829   8 58452 15411029 A  ERROR'
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:16:51 [DEBUG   ] spawn_process: at 2018-11-30 04:16:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:17:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 04:17:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:17:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:17:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:17:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:17:03 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-30 04:17:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 04:17:39 [DEBUG   ] Got command BAM from MCS: ref #673834
2018-11-30 04:17:39 [INFO    ] Finished processing BAM request
2018-11-30 04:17:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673834   8 58452 15459025 A  ERROR'
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:17:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:17:39 [DEBUG   ] spawn_process: at 2018-11-30 04:17:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:17:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:18:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 04:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:18:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:18:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:18:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:18:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:18:03 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-30 04:18:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 04:18:27 [DEBUG   ] Got command BAM from MCS: ref #673835
2018-11-30 04:18:27 [INFO    ] Finished processing BAM request
2018-11-30 04:18:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673835   8 58452 15507029 A  ERROR'
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:18:27 [DEBUG   ] spawn_process: at 2018-11-30 04:18:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:18:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:19:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 04:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:19:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:19:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:19:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:19:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:19:03 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 04:19:09 [DEBUG   ] Got command RPT from MCS: ref #673836
2018-11-30 04:19:09 [DEBUG   ] summary = ERROR
2018-11-30 04:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673836  13 58452 15549293 A  ERRORERROR'
2018-11-30 04:19:09 [DEBUG   ] Got command RPT from MCS: ref #673837
2018-11-30 04:19:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673837  77 58452 15549497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:19:09 [DEBUG   ] Got command RPT from MCS: ref #673838
2018-11-30 04:19:09 [DEBUG   ] summary = ERROR
2018-11-30 04:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673838  13 58452 15549701 A  ERRORERROR'
2018-11-30 04:19:09 [DEBUG   ] Got command RPT from MCS: ref #673839
2018-11-30 04:19:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673839  77 58452 15549905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:19:10 [DEBUG   ] Got command RPT from MCS: ref #673840
2018-11-30 04:19:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673840  12 58452 15550097 A  ERRORBœ™š'
2018-11-30 04:19:15 [DEBUG   ] Got command BAM from MCS: ref #673841
2018-11-30 04:19:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:19:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673841   8 58452 15555037 A  ERROR'
2018-11-30 04:19:15 [INFO    ] Finished processing BAM request
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:19:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:19:15 [DEBUG   ] spawn_process: at 2018-11-30 04:19:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:19:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:19:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:20:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 04:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:20:03 [DEBUG   ] Got command BAM from MCS: ref #673842
2018-11-30 04:20:03 [INFO    ] Finished processing BAM request
2018-11-30 04:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673842   8 58452 15603029 A  ERROR'
2018-11-30 04:20:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:20:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:20:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:20:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:20:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:20:03 [DEBUG   ] Finished updating board flags in 1.252 seconds
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:20:03 [DEBUG   ] spawn_process: at 2018-11-30 04:20:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:20:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:20:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:20:49 [DEBUG   ] Got command RPT from MCS: ref #673847
2018-11-30 04:20:49 [DEBUG   ] summary = ERROR
2018-11-30 04:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673847  13 58452 15649893 A  ERRORERROR'
2018-11-30 04:20:49 [DEBUG   ] Got command RPT from MCS: ref #673848
2018-11-30 04:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673848  77 58452 15649894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:20:51 [DEBUG   ] Got command BAM from MCS: ref #673864
2018-11-30 04:20:51 [INFO    ] Finished processing BAM request
2018-11-30 04:20:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:20:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673864   8 58452 15651025 A  ERROR'
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:20:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:20:51 [DEBUG   ] spawn_process: at 2018-11-30 04:20:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:21:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 04:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:21:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:21:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:21:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:21:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:21:03 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-30 04:21:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:21:39 [DEBUG   ] Got command BAM from MCS: ref #673865
2018-11-30 04:21:39 [INFO    ] Finished processing BAM request
2018-11-30 04:21:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673865   8 58452 15699029 A  ERROR'
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:21:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:21:39 [DEBUG   ] spawn_process: at 2018-11-30 04:21:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:21:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:22:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 04:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 04:22:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:22:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:22:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:22:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:22:03 [DEBUG   ] Finished updating board flags in 1.113 seconds
2018-11-30 04:22:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:22:27 [DEBUG   ] Got command BAM from MCS: ref #673866
2018-11-30 04:22:27 [INFO    ] Finished processing BAM request
2018-11-30 04:22:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673866   8 58452 15747033 A  ERROR'
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:22:27 [DEBUG   ] spawn_process: at 2018-11-30 04:22:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:22:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:23:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 04:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:23:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:23:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:23:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:23:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:23:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:23:03 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 04:23:15 [DEBUG   ] Got command BAM from MCS: ref #673867
2018-11-30 04:23:15 [INFO    ] Finished processing BAM request
2018-11-30 04:23:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673867   8 58452 15795025 A  ERROR'
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:23:15 [DEBUG   ] spawn_process: at 2018-11-30 04:23:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:23:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:23:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:24:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 04:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:24:03 [DEBUG   ] Got command BAM from MCS: ref #673874
2018-11-30 04:24:03 [INFO    ] Finished processing BAM request
2018-11-30 04:24:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:24:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673874   8 58452 15843033 A  ERROR'
2018-11-30 04:24:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:24:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:24:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:24:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:24:03 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:24:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:24:03 [DEBUG   ] spawn_process: at 2018-11-30 04:24:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:24:09 [DEBUG   ] Got command RPT from MCS: ref #673875
2018-11-30 04:24:09 [DEBUG   ] summary = ERROR
2018-11-30 04:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673875  13 58452 15849381 A  ERRORERROR'
2018-11-30 04:24:09 [DEBUG   ] Got command RPT from MCS: ref #673876
2018-11-30 04:24:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673876  77 58452 15849585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:24:09 [DEBUG   ] Got command RPT from MCS: ref #673877
2018-11-30 04:24:09 [DEBUG   ] summary = ERROR
2018-11-30 04:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673877  13 58452 15849789 A  ERRORERROR'
2018-11-30 04:24:09 [DEBUG   ] Got command RPT from MCS: ref #673879
2018-11-30 04:24:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:24:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673879  77 58452 15849981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:24:10 [DEBUG   ] Got command RPT from MCS: ref #673880
2018-11-30 04:24:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673880  12 58452 15850185 A  ERRORB�ff'
2018-11-30 04:24:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:24:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:24:51 [DEBUG   ] Got command BAM from MCS: ref #673885
2018-11-30 04:24:51 [INFO    ] Finished processing BAM request
2018-11-30 04:24:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673885   8 58452 15891025 A  ERROR'
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:24:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:24:51 [DEBUG   ] spawn_process: at 2018-11-30 04:24:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:25:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 04:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:25:03 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 04:25:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 04:25:39 [DEBUG   ] Got command BAM from MCS: ref #673886
2018-11-30 04:25:39 [INFO    ] Finished processing BAM request
2018-11-30 04:25:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673886   8 58452 15939033 A  ERROR'
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:25:39 [DEBUG   ] spawn_process: at 2018-11-30 04:25:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:25:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:25:49 [DEBUG   ] Got command RPT from MCS: ref #673887
2018-11-30 04:25:49 [DEBUG   ] summary = ERROR
2018-11-30 04:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673887  13 58452 15949897 A  ERRORERROR'
2018-11-30 04:25:49 [DEBUG   ] Got command RPT from MCS: ref #673888
2018-11-30 04:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673888  77 58452 15949898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:26:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 04:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 04:26:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:26:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:26:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:26:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:26:03 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-30 04:26:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:26:27 [DEBUG   ] Got command BAM from MCS: ref #673908
2018-11-30 04:26:27 [INFO    ] Finished processing BAM request
2018-11-30 04:26:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673908   8 58452 15987029 A  ERROR'
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:26:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:26:27 [DEBUG   ] spawn_process: at 2018-11-30 04:26:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:26:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:27:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 04:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:27:03 [DEBUG   ] Finished updating board flags in 1.265 seconds
2018-11-30 04:27:15 [DEBUG   ] Got command BAM from MCS: ref #673909
2018-11-30 04:27:15 [INFO    ] Finished processing BAM request
2018-11-30 04:27:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:27:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673909   8 58452 16035025 A  ERROR'
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:27:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:27:15 [DEBUG   ] spawn_process: at 2018-11-30 04:27:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:27:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:27:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:28:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 04:28:03 [DEBUG   ] Got command BAM from MCS: ref #673910
2018-11-30 04:28:03 [INFO    ] Finished processing BAM request
2018-11-30 04:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673910   8 58452 16083029 A  ERROR'
2018-11-30 04:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:28:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:28:03 [DEBUG   ] spawn_process: at 2018-11-30 04:28:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:28:03 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-30 04:28:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:28:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:28:51 [DEBUG   ] Got command BAM from MCS: ref #673911
2018-11-30 04:28:51 [INFO    ] Finished processing BAM request
2018-11-30 04:28:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673911   8 58452 16131033 A  ERROR'
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:28:51 [DEBUG   ] spawn_process: at 2018-11-30 04:28:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:29:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 04:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:29:03 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-30 04:29:09 [DEBUG   ] Got command RPT from MCS: ref #673912
2018-11-30 04:29:09 [DEBUG   ] summary = ERROR
2018-11-30 04:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673912  13 58452 16149465 A  ERRORERROR'
2018-11-30 04:29:09 [DEBUG   ] Got command RPT from MCS: ref #673913
2018-11-30 04:29:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673913  77 58452 16149669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:29:09 [DEBUG   ] Got command RPT from MCS: ref #673914
2018-11-30 04:29:09 [DEBUG   ] summary = ERROR
2018-11-30 04:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673914  13 58452 16149873 A  ERRORERROR'
2018-11-30 04:29:10 [DEBUG   ] Got command RPT from MCS: ref #673915
2018-11-30 04:29:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673915  77 58452 16150065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:29:10 [DEBUG   ] Got command RPT from MCS: ref #673916
2018-11-30 04:29:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673916  12 58452 16150269 A  ERRORBœ™š'
2018-11-30 04:29:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:29:39 [DEBUG   ] Got command BAM from MCS: ref #673921
2018-11-30 04:29:39 [INFO    ] Finished processing BAM request
2018-11-30 04:29:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673921   8 58452 16179029 A  ERROR'
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:29:39 [DEBUG   ] spawn_process: at 2018-11-30 04:29:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:29:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:30:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 04:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:30:03 [DEBUG   ] Finished updating board flags in 1.113 seconds
2018-11-30 04:30:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 04:30:27 [DEBUG   ] Got command BAM from MCS: ref #673922
2018-11-30 04:30:27 [INFO    ] Finished processing BAM request
2018-11-30 04:30:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673922   8 58452 16227025 A  ERROR'
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:30:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:30:27 [DEBUG   ] spawn_process: at 2018-11-30 04:30:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:30:49 [DEBUG   ] Got command RPT from MCS: ref #673923
2018-11-30 04:30:49 [DEBUG   ] summary = ERROR
2018-11-30 04:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673923  13 58452 16249901 A  ERRORERROR'
2018-11-30 04:30:49 [DEBUG   ] Got command RPT from MCS: ref #673924
2018-11-30 04:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673924  77 58452 16249902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:31:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 04:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 04:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:31:03 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-30 04:31:15 [DEBUG   ] Got command BAM from MCS: ref #673940
2018-11-30 04:31:15 [INFO    ] Finished processing BAM request
2018-11-30 04:31:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673940   8 58452 16275029 A  ERROR'
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:31:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:31:15 [DEBUG   ] spawn_process: at 2018-11-30 04:31:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:31:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:31:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:32:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:32:03 [DEBUG   ] Got command BAM from MCS: ref #673941
2018-11-30 04:32:03 [INFO    ] Finished processing BAM request
2018-11-30 04:32:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:32:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673941   8 58452 16323033 A  ERROR'
2018-11-30 04:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:32:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:32:03 [DEBUG   ] spawn_process: at 2018-11-30 04:32:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:32:04 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-11-30 04:32:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:32:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:32:51 [DEBUG   ] Got command BAM from MCS: ref #673946
2018-11-30 04:32:51 [INFO    ] Finished processing BAM request
2018-11-30 04:32:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:32:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673946   8 58452 16371029 A  ERROR'
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:32:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:32:51 [DEBUG   ] spawn_process: at 2018-11-30 04:32:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:33:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 04:33:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:33:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:33:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:33:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:33:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:33:04 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-30 04:33:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:33:39 [DEBUG   ] Got command BAM from MCS: ref #673947
2018-11-30 04:33:39 [INFO    ] Finished processing BAM request
2018-11-30 04:33:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673947   8 58452 16419029 A  ERROR'
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:33:39 [DEBUG   ] spawn_process: at 2018-11-30 04:33:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:33:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:34:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 04:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:34:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:34:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:34:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:34:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:34:04 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-30 04:34:09 [DEBUG   ] Got command RPT from MCS: ref #673950
2018-11-30 04:34:09 [DEBUG   ] summary = ERROR
2018-11-30 04:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673950  13 58452 16449553 A  ERRORERROR'
2018-11-30 04:34:09 [DEBUG   ] Got command RPT from MCS: ref #673951
2018-11-30 04:34:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673951  77 58452 16449757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:34:09 [DEBUG   ] Got command RPT from MCS: ref #673952
2018-11-30 04:34:09 [DEBUG   ] summary = ERROR
2018-11-30 04:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673952  13 58452 16449961 A  ERRORERROR'
2018-11-30 04:34:10 [DEBUG   ] Got command RPT from MCS: ref #673954
2018-11-30 04:34:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:34:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673954  77 58452 16450153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:34:10 [DEBUG   ] Got command RPT from MCS: ref #673955
2018-11-30 04:34:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:34:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673955  12 58452 16450357 A  ERRORBœ™š'
2018-11-30 04:34:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:34:27 [DEBUG   ] Got command BAM from MCS: ref #673960
2018-11-30 04:34:27 [INFO    ] Finished processing BAM request
2018-11-30 04:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673960   8 58452 16467033 A  ERROR'
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:34:27 [DEBUG   ] spawn_process: at 2018-11-30 04:34:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:34:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:35:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 04:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:35:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:35:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:35:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:35:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:35:04 [DEBUG   ] Finished updating board flags in 1.271 seconds
2018-11-30 04:35:15 [DEBUG   ] Got command BAM from MCS: ref #673961
2018-11-30 04:35:15 [INFO    ] Finished processing BAM request
2018-11-30 04:35:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673961   8 58452 16515033 A  ERROR'
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:35:15 [DEBUG   ] spawn_process: at 2018-11-30 04:35:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:35:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:35:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:35:49 [DEBUG   ] Got command RPT from MCS: ref #673966
2018-11-30 04:35:49 [DEBUG   ] summary = ERROR
2018-11-30 04:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673966  13 58452 16549909 A  ERRORERROR'
2018-11-30 04:35:49 [DEBUG   ] Got command RPT from MCS: ref #673967
2018-11-30 04:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673967  77 58452 16549910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:36:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 04:36:03 [DEBUG   ] Got command BAM from MCS: ref #673983
2018-11-30 04:36:03 [INFO    ] Finished processing BAM request
2018-11-30 04:36:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673983   8 58452 16563033 A  ERROR'
2018-11-30 04:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:36:03 [DEBUG   ] spawn_process: at 2018-11-30 04:36:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 04:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:36:04 [DEBUG   ] Finished updating board flags in 1.123 seconds
2018-11-30 04:36:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:36:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:36:51 [DEBUG   ] Got command BAM from MCS: ref #673984
2018-11-30 04:36:51 [INFO    ] Finished processing BAM request
2018-11-30 04:36:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673984   8 58452 16611030 A  ERROR'
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:36:51 [DEBUG   ] spawn_process: at 2018-11-30 04:36:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:37:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 04:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:37:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:37:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:37:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:37:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:37:04 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-30 04:37:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:37:39 [DEBUG   ] Got command BAM from MCS: ref #673985
2018-11-30 04:37:39 [INFO    ] Finished processing BAM request
2018-11-30 04:37:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673985   8 58452 16659029 A  ERROR'
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:37:39 [DEBUG   ] spawn_process: at 2018-11-30 04:37:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:37:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:38:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 04:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:38:04 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-30 04:38:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:38:27 [DEBUG   ] Got command BAM from MCS: ref #673990
2018-11-30 04:38:27 [INFO    ] Finished processing BAM request
2018-11-30 04:38:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673990   8 58452 16707029 A  ERROR'
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:38:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:38:27 [DEBUG   ] spawn_process: at 2018-11-30 04:38:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:38:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:39:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 04:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 04:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:39:04 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-30 04:39:09 [DEBUG   ] Got command RPT from MCS: ref #673991
2018-11-30 04:39:09 [DEBUG   ] summary = ERROR
2018-11-30 04:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673991  13 58452 16749641 A  ERRORERROR'
2018-11-30 04:39:09 [DEBUG   ] Got command RPT from MCS: ref #673992
2018-11-30 04:39:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673992  77 58452 16749845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:39:10 [DEBUG   ] Got command RPT from MCS: ref #673993
2018-11-30 04:39:10 [DEBUG   ] summary = ERROR
2018-11-30 04:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673993  13 58452 16750049 A  ERRORERROR'
2018-11-30 04:39:10 [DEBUG   ] Got command RPT from MCS: ref #673994
2018-11-30 04:39:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673994  77 58452 16750241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:39:10 [DEBUG   ] Got command RPT from MCS: ref #673995
2018-11-30 04:39:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673995  12 58452 16750445 A  ERRORB�ff'
2018-11-30 04:39:15 [DEBUG   ] Got command BAM from MCS: ref #673996
2018-11-30 04:39:15 [INFO    ] Finished processing BAM request
2018-11-30 04:39:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673996   8 58452 16755033 A  ERROR'
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:39:15 [DEBUG   ] spawn_process: at 2018-11-30 04:39:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:39:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:39:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:40:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 04:40:03 [DEBUG   ] Got command BAM from MCS: ref #673997
2018-11-30 04:40:03 [INFO    ] Finished processing BAM request
2018-11-30 04:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   673997   8 58452 16803029 A  ERROR'
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:40:03 [DEBUG   ] spawn_process: at 2018-11-30 04:40:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 04:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:40:04 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-11-30 04:40:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 04:40:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:40:49 [DEBUG   ] Got command RPT from MCS: ref #673998
2018-11-30 04:40:49 [DEBUG   ] summary = ERROR
2018-11-30 04:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673998  13 58452 16849917 A  ERRORERROR'
2018-11-30 04:40:49 [DEBUG   ] Got command RPT from MCS: ref #673999
2018-11-30 04:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673999  77 58452 16849918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:40:51 [DEBUG   ] Got command BAM from MCS: ref #674015
2018-11-30 04:40:51 [INFO    ] Finished processing BAM request
2018-11-30 04:40:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:40:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674015   8 58452 16851025 A  ERROR'
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:40:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:40:51 [DEBUG   ] spawn_process: at 2018-11-30 04:40:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:41:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:41:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:41:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:41:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:41:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:41:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:41:05 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-30 04:41:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:41:40 [DEBUG   ] Got command BAM from MCS: ref #674020
2018-11-30 04:41:40 [INFO    ] Finished processing BAM request
2018-11-30 04:41:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674020   8 58452 16900029 A  ERROR'
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:41:40 [DEBUG   ] spawn_process: at 2018-11-30 04:41:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:41:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-30 04:42:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:42:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:42:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:42:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:42:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:42:05 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-11-30 04:42:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:42:29 [DEBUG   ] Got command BAM from MCS: ref #674021
2018-11-30 04:42:29 [INFO    ] Finished processing BAM request
2018-11-30 04:42:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674021   8 58452 16949029 A  ERROR'
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:42:29 [DEBUG   ] spawn_process: at 2018-11-30 04:42:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:42:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:43:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:43:05 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-11-30 04:43:18 [DEBUG   ] Got command BAM from MCS: ref #674022
2018-11-30 04:43:18 [INFO    ] Finished processing BAM request
2018-11-30 04:43:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674022   8 58452 16998025 A  ERROR'
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:43:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:43:18 [DEBUG   ] spawn_process: at 2018-11-30 04:43:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:43:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:43:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:44:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:44:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:44:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:44:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:44:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:44:05 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-30 04:44:07 [DEBUG   ] Got command BAM from MCS: ref #674025
2018-11-30 04:44:07 [INFO    ] Finished processing BAM request
2018-11-30 04:44:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674025   8 58452 17047029 A  ERROR'
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:44:07 [DEBUG   ] spawn_process: at 2018-11-30 04:44:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:44:09 [DEBUG   ] Got command RPT from MCS: ref #674026
2018-11-30 04:44:09 [DEBUG   ] summary = ERROR
2018-11-30 04:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674026  13 58452 17049729 A  ERRORERROR'
2018-11-30 04:44:09 [DEBUG   ] Got command RPT from MCS: ref #674027
2018-11-30 04:44:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674027  77 58452 17049921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:44:10 [DEBUG   ] Got command RPT from MCS: ref #674028
2018-11-30 04:44:10 [DEBUG   ] summary = ERROR
2018-11-30 04:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674028  13 58452 17050125 A  ERRORERROR'
2018-11-30 04:44:10 [DEBUG   ] Got command RPT from MCS: ref #674030
2018-11-30 04:44:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674030  77 58452 17050329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:44:10 [DEBUG   ] Got command RPT from MCS: ref #674032
2018-11-30 04:44:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674032  12 58452 17050533 A  ERRORBœ™š'
2018-11-30 04:44:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:44:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:44:56 [DEBUG   ] Got command BAM from MCS: ref #674040
2018-11-30 04:44:56 [INFO    ] Finished processing BAM request
2018-11-30 04:44:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674040   8 58452 17096025 A  ERROR'
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:44:56 [DEBUG   ] spawn_process: at 2018-11-30 04:44:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:45:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:45:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:45:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:45:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:45:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:45:05 [DEBUG   ] Finished updating board flags in 1.330 seconds
2018-11-30 04:45:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:45:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:45:45 [DEBUG   ] Got command BAM from MCS: ref #674041
2018-11-30 04:45:45 [INFO    ] Finished processing BAM request
2018-11-30 04:45:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674041   8 58452 17145025 A  ERROR'
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:45:45 [DEBUG   ] spawn_process: at 2018-11-30 04:45:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:45:49 [DEBUG   ] Got command RPT from MCS: ref #674042
2018-11-30 04:45:49 [DEBUG   ] summary = ERROR
2018-11-30 04:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674042  13 58452 17149909 A  ERRORERROR'
2018-11-30 04:45:49 [DEBUG   ] Got command RPT from MCS: ref #674043
2018-11-30 04:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674043  77 58452 17149910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:46:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:46:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:46:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:46:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:46:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:46:05 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-30 04:46:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:46:34 [DEBUG   ] Got command BAM from MCS: ref #674059
2018-11-30 04:46:34 [INFO    ] Finished processing BAM request
2018-11-30 04:46:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674059   8 58452 17194025 A  ERROR'
2018-11-30 04:46:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:46:34 [DEBUG   ] spawn_process: at 2018-11-30 04:46:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:46:35 [DEBUG   ] spawn_process: at 2018-11-30 04:46:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:46:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:47:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 04:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 04:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:47:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:47:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:47:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:47:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:47:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:47:05 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-30 04:47:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 04:47:23 [DEBUG   ] Got command BAM from MCS: ref #674062
2018-11-30 04:47:23 [INFO    ] Finished processing BAM request
2018-11-30 04:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674062   8 58452 17243029 A  ERROR'
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:47:23 [DEBUG   ] spawn_process: at 2018-11-30 04:47:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:47:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:48:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:48:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:48:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:48:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:48:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:48:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:48:05 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-30 04:48:12 [DEBUG   ] Got command BAM from MCS: ref #674065
2018-11-30 04:48:12 [INFO    ] Finished processing BAM request
2018-11-30 04:48:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674065   8 58452 17292025 A  ERROR'
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:48:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:48:12 [DEBUG   ] spawn_process: at 2018-11-30 04:48:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:48:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:48:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:49:01 [DEBUG   ] Got command BAM from MCS: ref #674066
2018-11-30 04:49:01 [INFO    ] Finished processing BAM request
2018-11-30 04:49:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674066   8 58452 17341029 A  ERROR'
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:49:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:49:01 [DEBUG   ] spawn_process: at 2018-11-30 04:49:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:49:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:49:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:49:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:49:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:49:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:49:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:49:05 [DEBUG   ] Finished updating board flags in 0.978 seconds
2018-11-30 04:49:09 [DEBUG   ] Got command RPT from MCS: ref #674067
2018-11-30 04:49:09 [DEBUG   ] summary = ERROR
2018-11-30 04:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674067  13 58452 17349817 A  ERRORERROR'
2018-11-30 04:49:10 [DEBUG   ] Got command RPT from MCS: ref #674068
2018-11-30 04:49:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674068  77 58452 17350009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:49:10 [DEBUG   ] Got command RPT from MCS: ref #674069
2018-11-30 04:49:10 [DEBUG   ] summary = ERROR
2018-11-30 04:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674069  13 58452 17350213 A  ERRORERROR'
2018-11-30 04:49:10 [DEBUG   ] Got command RPT from MCS: ref #674070
2018-11-30 04:49:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674070  77 58452 17350417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:49:10 [DEBUG   ] Got command RPT from MCS: ref #674071
2018-11-30 04:49:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674071  12 58452 17350609 A  ERRORBœ™š'
2018-11-30 04:49:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:49:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:49:50 [DEBUG   ] Got command BAM from MCS: ref #674072
2018-11-30 04:49:50 [INFO    ] Finished processing BAM request
2018-11-30 04:49:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674072   8 58452 17390033 A  ERROR'
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:49:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:49:50 [DEBUG   ] spawn_process: at 2018-11-30 04:49:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:50:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 04:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:50:06 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-11-30 04:50:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 04:50:39 [DEBUG   ] Got command BAM from MCS: ref #674077
2018-11-30 04:50:39 [INFO    ] Finished processing BAM request
2018-11-30 04:50:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674077   8 58452 17439029 A  ERROR'
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:50:39 [DEBUG   ] spawn_process: at 2018-11-30 04:50:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:50:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 04:50:49 [DEBUG   ] Got command RPT from MCS: ref #674078
2018-11-30 04:50:49 [DEBUG   ] summary = ERROR
2018-11-30 04:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674078  13 58452 17449909 A  ERRORERROR'
2018-11-30 04:50:49 [DEBUG   ] Got command RPT from MCS: ref #674079
2018-11-30 04:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674079  77 58452 17449910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:51:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 04:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 04:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:51:05 [DEBUG   ] Finished updating board flags in 1.246 seconds
2018-11-30 04:51:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:51:29 [DEBUG   ] Got command BAM from MCS: ref #674095
2018-11-30 04:51:29 [INFO    ] Finished processing BAM request
2018-11-30 04:51:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674095   8 58452 17489025 A  ERROR'
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:51:29 [DEBUG   ] spawn_process: at 2018-11-30 04:51:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:51:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:52:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 04:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:52:05 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-30 04:52:19 [DEBUG   ] Got command BAM from MCS: ref #674096
2018-11-30 04:52:19 [INFO    ] Finished processing BAM request
2018-11-30 04:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674096   8 58452 17539029 A  ERROR'
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:52:19 [DEBUG   ] spawn_process: at 2018-11-30 04:52:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:52:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:52:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:53:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:53:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:53:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:53:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:53:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:53:06 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-11-30 04:53:09 [DEBUG   ] Got command BAM from MCS: ref #674097
2018-11-30 04:53:09 [INFO    ] Finished processing BAM request
2018-11-30 04:53:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674097   8 58452 17589029 A  ERROR'
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:53:09 [DEBUG   ] spawn_process: at 2018-11-30 04:53:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:53:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:53:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:53:59 [DEBUG   ] Got command BAM from MCS: ref #674104
2018-11-30 04:53:59 [INFO    ] Finished processing BAM request
2018-11-30 04:53:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674104   8 58452 17639025 A  ERROR'
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 04:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 04:53:59 [DEBUG   ] spawn_process: at 2018-11-30 04:53:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 04:54:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:54:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:54:06 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-30 04:54:09 [DEBUG   ] Got command RPT from MCS: ref #674105
2018-11-30 04:54:09 [DEBUG   ] summary = ERROR
2018-11-30 04:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674105  13 58452 17649897 A  ERRORERROR'
2018-11-30 04:54:10 [DEBUG   ] Got command RPT from MCS: ref #674106
2018-11-30 04:54:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674106  77 58452 17650101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:54:10 [DEBUG   ] Got command RPT from MCS: ref #674107
2018-11-30 04:54:10 [DEBUG   ] summary = ERROR
2018-11-30 04:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674107  13 58452 17650305 A  ERRORERROR'
2018-11-30 04:54:10 [DEBUG   ] Got command RPT from MCS: ref #674109
2018-11-30 04:54:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674109  77 58452 17650497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:54:10 [DEBUG   ] Got command RPT from MCS: ref #674110
2018-11-30 04:54:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674110  12 58452 17650701 A  ERRORB�ff'
2018-11-30 04:54:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:54:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:54:49 [DEBUG   ] Got command BAM from MCS: ref #674115
2018-11-30 04:54:49 [INFO    ] Finished processing BAM request
2018-11-30 04:54:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674115   8 58452 17689025 A  ERROR'
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:54:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:54:49 [DEBUG   ] spawn_process: at 2018-11-30 04:54:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:55:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:55:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 04:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:55:06 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-30 04:55:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:55:39 [DEBUG   ] Got command BAM from MCS: ref #674116
2018-11-30 04:55:39 [INFO    ] Finished processing BAM request
2018-11-30 04:55:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:55:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674116   8 58452 17739029 A  ERROR'
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:55:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:55:39 [DEBUG   ] spawn_process: at 2018-11-30 04:55:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:55:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:55:49 [DEBUG   ] Got command RPT from MCS: ref #674117
2018-11-30 04:55:49 [DEBUG   ] summary = ERROR
2018-11-30 04:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674117  13 58452 17749905 A  ERRORERROR'
2018-11-30 04:55:49 [DEBUG   ] Got command RPT from MCS: ref #674118
2018-11-30 04:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674118  77 58452 17749906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:56:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:56:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:56:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:56:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:56:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:56:06 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-30 04:56:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:56:29 [DEBUG   ] Got command BAM from MCS: ref #674138
2018-11-30 04:56:29 [INFO    ] Finished processing BAM request
2018-11-30 04:56:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674138   8 58452 17789025 A  ERROR'
2018-11-30 04:56:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 04:56:29 [DEBUG   ] spawn_process: at 2018-11-30 04:56:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 04:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 04:56:30 [DEBUG   ] spawn_process: at 2018-11-30 04:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 04:56:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:57:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 04:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 04:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:57:06 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-11-30 04:57:19 [DEBUG   ] Got command BAM from MCS: ref #674139
2018-11-30 04:57:19 [INFO    ] Finished processing BAM request
2018-11-30 04:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674139   8 58452 17839029 A  ERROR'
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:57:19 [DEBUG   ] spawn_process: at 2018-11-30 04:57:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 04:57:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:57:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:58:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:58:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:58:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:58:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:58:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:58:06 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-11-30 04:58:10 [DEBUG   ] Got command BAM from MCS: ref #674140
2018-11-30 04:58:10 [INFO    ] Finished processing BAM request
2018-11-30 04:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674140   8 58452 17890025 A  ERROR'
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 04:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 04:58:10 [DEBUG   ] spawn_process: at 2018-11-30 04:58:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 04:58:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:58:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:59:01 [DEBUG   ] Got command BAM from MCS: ref #674141
2018-11-30 04:59:01 [INFO    ] Finished processing BAM request
2018-11-30 04:59:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674141   8 58452 17941029 A  ERROR'
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 04:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 04:59:01 [DEBUG   ] spawn_process: at 2018-11-30 04:59:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 04:59:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 04:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 04:59:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 04:59:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:59:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:59:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:59:06 [WARNING ] (13, 1, 'bot')
2018-11-30 04:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 04:59:06 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-11-30 04:59:09 [DEBUG   ] Got command RPT from MCS: ref #674142
2018-11-30 04:59:09 [DEBUG   ] summary = ERROR
2018-11-30 04:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674142  13 58452 17949985 A  ERRORERROR'
2018-11-30 04:59:10 [DEBUG   ] Got command RPT from MCS: ref #674143
2018-11-30 04:59:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674143  77 58452 17950189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:59:10 [DEBUG   ] Got command RPT from MCS: ref #674144
2018-11-30 04:59:10 [DEBUG   ] summary = ERROR
2018-11-30 04:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674144  13 58452 17950381 A  ERRORERROR'
2018-11-30 04:59:10 [DEBUG   ] Got command RPT from MCS: ref #674145
2018-11-30 04:59:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 04:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674145  77 58452 17950585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 04:59:10 [DEBUG   ] Got command RPT from MCS: ref #674146
2018-11-30 04:59:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 04:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674146  12 58452 17950789 A  ERRORB›™š'
2018-11-30 04:59:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 04:59:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 04:59:52 [DEBUG   ] Got command BAM from MCS: ref #674151
2018-11-30 04:59:52 [INFO    ] Finished processing BAM request
2018-11-30 04:59:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 04:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674151   8 58452 17992025 A  ERROR'
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 04:59:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 04:59:52 [DEBUG   ] spawn_process: at 2018-11-30 04:59:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:00:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:00:06 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-30 05:00:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:00:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:00:43 [DEBUG   ] Got command BAM from MCS: ref #674152
2018-11-30 05:00:43 [INFO    ] Finished processing BAM request
2018-11-30 05:00:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:00:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674152   8 58452 18043025 A  ERROR'
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:00:43 [DEBUG   ] spawn_process: at 2018-11-30 05:00:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:00:49 [DEBUG   ] Got command RPT from MCS: ref #674153
2018-11-30 05:00:49 [DEBUG   ] summary = ERROR
2018-11-30 05:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674153  13 58452 18049913 A  ERRORERROR'
2018-11-30 05:00:49 [DEBUG   ] Got command RPT from MCS: ref #674154
2018-11-30 05:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674154  77 58452 18049914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:01:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:01:06 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-30 05:01:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:01:34 [DEBUG   ] Got command BAM from MCS: ref #674170
2018-11-30 05:01:34 [INFO    ] Finished processing BAM request
2018-11-30 05:01:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674170   8 58452 18094033 A  ERROR'
2018-11-30 05:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:01:34 [DEBUG   ] spawn_process: at 2018-11-30 05:01:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:01:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:01:35 [DEBUG   ] spawn_process: at 2018-11-30 05:01:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:01:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:02:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:02:06 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-11-30 05:02:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:02:25 [DEBUG   ] Got command BAM from MCS: ref #674175
2018-11-30 05:02:25 [INFO    ] Finished processing BAM request
2018-11-30 05:02:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674175   8 58452 18145029 A  ERROR'
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 05:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 05:02:25 [DEBUG   ] spawn_process: at 2018-11-30 05:02:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:02:42 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-30 05:03:02 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 05:03:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 05:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:03:06 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-30 05:03:16 [DEBUG   ] Got command BAM from MCS: ref #674176
2018-11-30 05:03:16 [INFO    ] Finished processing BAM request
2018-11-30 05:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674176   8 58452 18196029 A  ERROR'
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:03:16 [DEBUG   ] spawn_process: at 2018-11-30 05:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:03:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 05:03:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 05:04:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 05:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 05:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:04:06 [DEBUG   ] Finished updating board flags in 1.137 seconds
2018-11-30 05:04:08 [DEBUG   ] Got command BAM from MCS: ref #674179
2018-11-30 05:04:08 [INFO    ] Finished processing BAM request
2018-11-30 05:04:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:04:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674179   8 58452 18248025 A  ERROR'
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 05:04:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 05:04:08 [DEBUG   ] spawn_process: at 2018-11-30 05:04:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 05:04:10 [DEBUG   ] Got command RPT from MCS: ref #674180
2018-11-30 05:04:10 [DEBUG   ] summary = ERROR
2018-11-30 05:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674180  13 58452 18250065 A  ERRORERROR'
2018-11-30 05:04:10 [DEBUG   ] Got command RPT from MCS: ref #674181
2018-11-30 05:04:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674181  77 58452 18250269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:04:10 [DEBUG   ] Got command RPT from MCS: ref #674182
2018-11-30 05:04:10 [DEBUG   ] summary = ERROR
2018-11-30 05:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674182  13 58452 18250473 A  ERRORERROR'
2018-11-30 05:04:10 [DEBUG   ] Got command RPT from MCS: ref #674184
2018-11-30 05:04:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674184  77 58452 18250665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:04:10 [DEBUG   ] Got command RPT from MCS: ref #674185
2018-11-30 05:04:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674185  12 58452 18250869 A  ERRORBœ™š'
2018-11-30 05:04:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 05:04:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:05:00 [DEBUG   ] Got command BAM from MCS: ref #674190
2018-11-30 05:05:00 [INFO    ] Finished processing BAM request
2018-11-30 05:05:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674190   8 58452 18300029 A  ERROR'
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:05:00 [DEBUG   ] spawn_process: at 2018-11-30 05:05:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:05:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:05:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 05:05:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 05:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:05:06 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-30 05:05:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:05:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:05:49 [DEBUG   ] Got command RPT from MCS: ref #674195
2018-11-30 05:05:49 [DEBUG   ] summary = ERROR
2018-11-30 05:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674195  13 58452 18349909 A  ERRORERROR'
2018-11-30 05:05:49 [DEBUG   ] Got command RPT from MCS: ref #674196
2018-11-30 05:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674196  77 58452 18349910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:05:52 [DEBUG   ] Got command BAM from MCS: ref #674212
2018-11-30 05:05:52 [INFO    ] Finished processing BAM request
2018-11-30 05:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674212   8 58452 18352025 A  ERROR'
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 05:05:52 [DEBUG   ] spawn_process: at 2018-11-30 05:05:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 05:06:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:06:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:06:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 05:06:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 05:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 05:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:06:06 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-11-30 05:06:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:06:43 [DEBUG   ] Finished updating ant stats in 0.786 seconds
2018-11-30 05:06:44 [DEBUG   ] Got command BAM from MCS: ref #674213
2018-11-30 05:06:44 [INFO    ] Finished processing BAM request
2018-11-30 05:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674213   8 58452 18404025 A  ERROR'
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:06:44 [DEBUG   ] spawn_process: at 2018-11-30 05:06:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:07:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 05:07:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:07:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:07:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:07:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:07:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:07:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:07:07 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-30 05:07:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:07:36 [DEBUG   ] Got command BAM from MCS: ref #674214
2018-11-30 05:07:36 [INFO    ] Finished processing BAM request
2018-11-30 05:07:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674214   8 58452 18456025 A  ERROR'
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:07:36 [DEBUG   ] spawn_process: at 2018-11-30 05:07:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:07:43 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-30 05:08:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:08:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:08:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:08:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:08:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:08:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:08:07 [DEBUG   ] Finished updating board flags in 1.173 seconds
2018-11-30 05:08:23 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 05:08:28 [DEBUG   ] Got command BAM from MCS: ref #674219
2018-11-30 05:08:28 [INFO    ] Finished processing BAM request
2018-11-30 05:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674219   8 58452 18508029 A  ERROR'
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 05:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 05:08:28 [DEBUG   ] spawn_process: at 2018-11-30 05:08:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 05:08:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:09:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:09:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:09:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 05:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:09:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:09:07 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-30 05:09:10 [DEBUG   ] Got command RPT from MCS: ref #674220
2018-11-30 05:09:10 [DEBUG   ] summary = ERROR
2018-11-30 05:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674220  13 58452 18550153 A  ERRORERROR'
2018-11-30 05:09:10 [DEBUG   ] Got command RPT from MCS: ref #674221
2018-11-30 05:09:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674221  77 58452 18550357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:09:10 [DEBUG   ] Got command RPT from MCS: ref #674222
2018-11-30 05:09:10 [DEBUG   ] summary = ERROR
2018-11-30 05:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674222  13 58452 18550549 A  ERRORERROR'
2018-11-30 05:09:10 [DEBUG   ] Got command RPT from MCS: ref #674223
2018-11-30 05:09:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674223  77 58452 18550753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:09:10 [DEBUG   ] Got command RPT from MCS: ref #674224
2018-11-30 05:09:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674224  12 58452 18550957 A  ERRORB�ff'
2018-11-30 05:09:21 [DEBUG   ] Got command BAM from MCS: ref #674225
2018-11-30 05:09:21 [INFO    ] Finished processing BAM request
2018-11-30 05:09:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674225   8 58452 18561029 A  ERROR'
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 05:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 05:09:21 [DEBUG   ] spawn_process: at 2018-11-30 05:09:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 05:09:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:09:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:10:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:10:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 05:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:10:07 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-30 05:10:14 [DEBUG   ] Got command BAM from MCS: ref #674226
2018-11-30 05:10:14 [INFO    ] Finished processing BAM request
2018-11-30 05:10:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674226   8 58452 18614034 A  ERROR'
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:10:14 [DEBUG   ] spawn_process: at 2018-11-30 05:10:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:10:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:10:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:10:49 [DEBUG   ] Got command RPT from MCS: ref #674227
2018-11-30 05:10:49 [DEBUG   ] summary = ERROR
2018-11-30 05:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674227  13 58452 18649913 A  ERRORERROR'
2018-11-30 05:10:49 [DEBUG   ] Got command RPT from MCS: ref #674228
2018-11-30 05:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674228  77 58452 18649914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:11:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 05:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:11:07 [DEBUG   ] Got command BAM from MCS: ref #674244
2018-11-30 05:11:07 [INFO    ] Finished processing BAM request
2018-11-30 05:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674244   8 58452 18667033 A  ERROR'
2018-11-30 05:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:11:07 [DEBUG   ] Finished updating board flags in 0.979 seconds
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 05:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 05:11:07 [DEBUG   ] spawn_process: at 2018-11-30 05:11:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:11:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-30 05:11:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:12:00 [DEBUG   ] Got command BAM from MCS: ref #674249
2018-11-30 05:12:00 [INFO    ] Finished processing BAM request
2018-11-30 05:12:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674249   8 58452 18720029 A  ERROR'
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 05:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 05:12:00 [DEBUG   ] spawn_process: at 2018-11-30 05:12:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:12:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-11-30 05:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:12:08 [DEBUG   ] Finished updating board flags in 1.866 seconds
2018-11-30 05:12:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:12:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:12:53 [DEBUG   ] Got command BAM from MCS: ref #674250
2018-11-30 05:12:53 [INFO    ] Finished processing BAM request
2018-11-30 05:12:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:12:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674250   8 58452 18773025 A  ERROR'
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 05:12:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 05:12:53 [DEBUG   ] spawn_process: at 2018-11-30 05:12:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 05:13:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:13:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:13:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:13:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:13:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:13:07 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-11-30 05:13:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:13:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:13:47 [DEBUG   ] Got command BAM from MCS: ref #674251
2018-11-30 05:13:47 [INFO    ] Finished processing BAM request
2018-11-30 05:13:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674251   8 58452 18827033 A  ERROR'
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:13:47 [DEBUG   ] spawn_process: at 2018-11-30 05:13:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:14:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:14:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:14:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:14:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:14:07 [WARNING ] (13, 1, 'bot')
2018-11-30 05:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:14:07 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-11-30 05:14:10 [DEBUG   ] Got command RPT from MCS: ref #674254
2018-11-30 05:14:10 [DEBUG   ] summary = ERROR
2018-11-30 05:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674254  13 58452 18850233 A  ERRORERROR'
2018-11-30 05:14:10 [DEBUG   ] Got command RPT from MCS: ref #674255
2018-11-30 05:14:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674255  77 58452 18850437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:14:10 [DEBUG   ] Got command RPT from MCS: ref #674256
2018-11-30 05:14:10 [DEBUG   ] summary = ERROR
2018-11-30 05:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674256  13 58452 18850641 A  ERRORERROR'
2018-11-30 05:14:10 [DEBUG   ] Got command RPT from MCS: ref #674258
2018-11-30 05:14:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:14:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674258  77 58452 18850845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:14:11 [DEBUG   ] Got command RPT from MCS: ref #674259
2018-11-30 05:14:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674259  12 58452 18851037 A  ERRORB›™š'
2018-11-30 05:14:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:14:41 [DEBUG   ] Got command BAM from MCS: ref #674268
2018-11-30 05:14:41 [INFO    ] Finished processing BAM request
2018-11-30 05:14:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674268   8 58452 18881029 A  ERROR'
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:14:41 [DEBUG   ] spawn_process: at 2018-11-30 05:14:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:14:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:15:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:15:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:15:08 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-11-30 05:15:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:15:35 [DEBUG   ] Got command BAM from MCS: ref #674269
2018-11-30 05:15:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674269   8 58452 18935118 A  ERROR'
2018-11-30 05:15:35 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-30 05:15:35 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-30 05:15:35 [INFO    ] Finished processing BAM request
2018-11-30 05:15:35 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-30 05:15:35 [DEBUG   ] 
2018-11-30 05:15:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:15:49 [DEBUG   ] Got command RPT from MCS: ref #674270
2018-11-30 05:15:49 [DEBUG   ] summary = ERROR
2018-11-30 05:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674270  13 58452 18949913 A  ERRORERROR'
2018-11-30 05:15:49 [DEBUG   ] Got command RPT from MCS: ref #674271
2018-11-30 05:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674271  77 58452 18949914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:16:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:16:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:16:08 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-30 05:16:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:16:29 [DEBUG   ] Got command BAM from MCS: ref #674287
2018-11-30 05:16:29 [INFO    ] Finished processing BAM request
2018-11-30 05:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674287   8 58452 18989025 A  ERROR'
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:16:29 [DEBUG   ] spawn_process: at 2018-11-30 05:16:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:16:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:17:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:17:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:17:08 [DEBUG   ] Finished updating board flags in 1.171 seconds
2018-11-30 05:17:23 [DEBUG   ] Got command BAM from MCS: ref #674288
2018-11-30 05:17:23 [INFO    ] Finished processing BAM request
2018-11-30 05:17:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674288   8 58452 19043026 A  ERROR'
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:17:23 [DEBUG   ] spawn_process: at 2018-11-30 05:17:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:17:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:17:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:18:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:18:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:18:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 05:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:18:08 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-11-30 05:18:18 [DEBUG   ] Got command BAM from MCS: ref #674293
2018-11-30 05:18:18 [INFO    ] Finished processing BAM request
2018-11-30 05:18:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674293   8 58452 19098025 A  ERROR'
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:18:18 [DEBUG   ] spawn_process: at 2018-11-30 05:18:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:18:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:18:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:19:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:19:09 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-11-30 05:19:10 [DEBUG   ] Got command RPT from MCS: ref #674294
2018-11-30 05:19:10 [DEBUG   ] summary = ERROR
2018-11-30 05:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674294  13 58452 19150325 A  ERRORERROR'
2018-11-30 05:19:10 [DEBUG   ] Got command RPT from MCS: ref #674295
2018-11-30 05:19:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674295  77 58452 19150529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:19:10 [DEBUG   ] Got command RPT from MCS: ref #674296
2018-11-30 05:19:10 [DEBUG   ] summary = ERROR
2018-11-30 05:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674296  13 58452 19150721 A  ERRORERROR'
2018-11-30 05:19:10 [DEBUG   ] Got command RPT from MCS: ref #674297
2018-11-30 05:19:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674297  77 58452 19150925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:19:11 [DEBUG   ] Got command RPT from MCS: ref #674298
2018-11-30 05:19:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674298  12 58452 19151129 A  ERRORBœ™š'
2018-11-30 05:19:13 [DEBUG   ] Got command BAM from MCS: ref #674299
2018-11-30 05:19:13 [INFO    ] Finished processing BAM request
2018-11-30 05:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674299   8 58452 19153029 A  ERROR'
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 05:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 05:19:13 [DEBUG   ] spawn_process: at 2018-11-30 05:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 05:19:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:19:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:20:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:20:08 [DEBUG   ] Got command BAM from MCS: ref #674300
2018-11-30 05:20:08 [INFO    ] Finished processing BAM request
2018-11-30 05:20:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674300   8 58452 19208033 A  ERROR'
2018-11-30 05:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:20:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 05:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:20:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:20:08 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 05:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 05:20:08 [DEBUG   ] spawn_process: at 2018-11-30 05:20:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 05:20:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:20:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:20:49 [DEBUG   ] Got command RPT from MCS: ref #674305
2018-11-30 05:20:49 [DEBUG   ] summary = ERROR
2018-11-30 05:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674305  13 58452 19249921 A  ERRORERROR'
2018-11-30 05:20:49 [DEBUG   ] Got command RPT from MCS: ref #674306
2018-11-30 05:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674306  77 58452 19249922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:21:03 [DEBUG   ] Got command BAM from MCS: ref #674322
2018-11-30 05:21:03 [INFO    ] Finished processing BAM request
2018-11-30 05:21:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:21:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674322   8 58452 19263029 A  ERROR'
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:21:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:21:03 [DEBUG   ] spawn_process: at 2018-11-30 05:21:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:21:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:21:08 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-30 05:21:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:21:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:21:59 [DEBUG   ] Got command BAM from MCS: ref #674323
2018-11-30 05:21:59 [INFO    ] Finished processing BAM request
2018-11-30 05:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674323   8 58452 19319033 A  ERROR'
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 05:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 05:21:59 [DEBUG   ] spawn_process: at 2018-11-30 05:21:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 05:22:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:22:08 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-11-30 05:22:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:22:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:22:55 [DEBUG   ] Got command BAM from MCS: ref #674324
2018-11-30 05:22:55 [INFO    ] Finished processing BAM request
2018-11-30 05:22:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:22:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674324   8 58452 19375033 A  ERROR'
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 05:22:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 05:22:55 [DEBUG   ] spawn_process: at 2018-11-30 05:22:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:23:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:23:08 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 05:23:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:23:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:23:51 [DEBUG   ] Got command BAM from MCS: ref #674331
2018-11-30 05:23:51 [INFO    ] Finished processing BAM request
2018-11-30 05:23:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:23:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674331   8 58452 19431029 A  ERROR'
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 05:23:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 05:23:51 [DEBUG   ] spawn_process: at 2018-11-30 05:23:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 05:24:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:24:08 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 05:24:10 [DEBUG   ] Got command RPT from MCS: ref #674332
2018-11-30 05:24:10 [DEBUG   ] summary = ERROR
2018-11-30 05:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674332  13 58452 19450409 A  ERRORERROR'
2018-11-30 05:24:10 [DEBUG   ] Got command RPT from MCS: ref #674333
2018-11-30 05:24:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674333  77 58452 19450613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:24:10 [DEBUG   ] Got command RPT from MCS: ref #674334
2018-11-30 05:24:10 [DEBUG   ] summary = ERROR
2018-11-30 05:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674334  13 58452 19450805 A  ERRORERROR'
2018-11-30 05:24:11 [DEBUG   ] Got command RPT from MCS: ref #674336
2018-11-30 05:24:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674336  77 58452 19451009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:24:11 [DEBUG   ] Got command RPT from MCS: ref #674338
2018-11-30 05:24:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674338  12 58452 19451213 A  ERRORB�ff'
2018-11-30 05:24:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:24:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:24:47 [DEBUG   ] Got command BAM from MCS: ref #674342
2018-11-30 05:24:47 [INFO    ] Finished processing BAM request
2018-11-30 05:24:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674342   8 58452 19487025 A  ERROR'
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 05:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 05:24:47 [DEBUG   ] spawn_process: at 2018-11-30 05:24:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 05:25:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 05:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:25:08 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-30 05:25:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:25:44 [DEBUG   ] Got command BAM from MCS: ref #674343
2018-11-30 05:25:44 [INFO    ] Finished processing BAM request
2018-11-30 05:25:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674343   8 58452 19544029 A  ERROR'
2018-11-30 05:25:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:25:44 [DEBUG   ] spawn_process: at 2018-11-30 05:25:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:25:49 [DEBUG   ] Got command RPT from MCS: ref #674344
2018-11-30 05:25:49 [DEBUG   ] summary = ERROR
2018-11-30 05:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674344  13 58452 19549917 A  ERRORERROR'
2018-11-30 05:25:49 [DEBUG   ] Got command RPT from MCS: ref #674345
2018-11-30 05:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674345  77 58452 19549918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:26:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:26:09 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-11-30 05:26:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:26:41 [DEBUG   ] Got command BAM from MCS: ref #674365
2018-11-30 05:26:41 [INFO    ] Finished processing BAM request
2018-11-30 05:26:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674365   8 58452 19601025 A  ERROR'
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 05:26:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 05:26:41 [DEBUG   ] spawn_process: at 2018-11-30 05:26:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:26:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:27:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:27:09 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 05:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:27:09 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-30 05:27:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:27:38 [DEBUG   ] Got command BAM from MCS: ref #674366
2018-11-30 05:27:38 [INFO    ] Finished processing BAM request
2018-11-30 05:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674366   8 58452 19658033 A  ERROR'
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:27:38 [DEBUG   ] spawn_process: at 2018-11-30 05:27:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:27:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:28:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 05:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:28:09 [DEBUG   ] Finished updating board flags in 1.333 seconds
2018-11-30 05:28:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:28:36 [DEBUG   ] Got command BAM from MCS: ref #674367
2018-11-30 05:28:36 [INFO    ] Finished processing BAM request
2018-11-30 05:28:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674367   8 58452 19716033 A  ERROR'
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 05:28:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 05:28:36 [DEBUG   ] spawn_process: at 2018-11-30 05:28:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 05:28:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:29:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:29:09 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-30 05:29:10 [DEBUG   ] Got command RPT from MCS: ref #674368
2018-11-30 05:29:10 [DEBUG   ] summary = ERROR
2018-11-30 05:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674368  13 58452 19750497 A  ERRORERROR'
2018-11-30 05:29:10 [DEBUG   ] Got command RPT from MCS: ref #674369
2018-11-30 05:29:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674369  77 58452 19750689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:29:10 [DEBUG   ] Got command RPT from MCS: ref #674370
2018-11-30 05:29:10 [DEBUG   ] summary = ERROR
2018-11-30 05:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674370  13 58452 19750893 A  ERRORERROR'
2018-11-30 05:29:11 [DEBUG   ] Got command RPT from MCS: ref #674371
2018-11-30 05:29:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674371  77 58452 19751101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:29:11 [DEBUG   ] Got command RPT from MCS: ref #674372
2018-11-30 05:29:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674372  12 58452 19751293 A  ERRORB›™š'
2018-11-30 05:29:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:29:34 [DEBUG   ] Got command BAM from MCS: ref #674377
2018-11-30 05:29:34 [INFO    ] Finished processing BAM request
2018-11-30 05:29:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 05:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674377   8 58452 19774025 A  ERROR'
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 05:29:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 05:29:34 [DEBUG   ] spawn_process: at 2018-11-30 05:29:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 05:29:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:30:00 [DEBUG   ] Got command STP from MCS: ref #674378
2018-11-30 05:30:00 [INFO    ] Finished processing BAM request
2018-11-30 05:30:00 [INFO    ] Shutdown the adder chain on beam #3
2018-11-30 05:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   674378   8 58452 19800033 A  ERROR'
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 05:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 05:30:00 [DEBUG   ] spawn_process: at 2018-11-30 05:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 05:30:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:30:09 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-30 05:30:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:30:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:30:49 [DEBUG   ] Got command RPT from MCS: ref #674379
2018-11-30 05:30:49 [DEBUG   ] summary = ERROR
2018-11-30 05:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674379  13 58452 19849921 A  ERRORERROR'
2018-11-30 05:30:49 [DEBUG   ] Got command RPT from MCS: ref #674380
2018-11-30 05:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674380  77 58452 19849922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:31:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:31:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:31:09 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-30 05:31:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:31:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:32:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:32:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:32:09 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-11-30 05:32:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:32:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:33:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:33:09 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-11-30 05:33:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 05:33:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 05:34:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 05:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:34:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 05:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:34:09 [DEBUG   ] Finished updating board flags in 1.307 seconds
2018-11-30 05:34:10 [DEBUG   ] Got command RPT from MCS: ref #674402
2018-11-30 05:34:10 [DEBUG   ] summary = ERROR
2018-11-30 05:34:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674402  13 58452 20050577 A  ERRORERROR'
2018-11-30 05:34:10 [DEBUG   ] Got command RPT from MCS: ref #674403
2018-11-30 05:34:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:34:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674403  77 58452 20050781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:34:10 [DEBUG   ] Got command RPT from MCS: ref #674404
2018-11-30 05:34:10 [DEBUG   ] summary = ERROR
2018-11-30 05:34:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674404  13 58452 20050973 A  ERRORERROR'
2018-11-30 05:34:11 [DEBUG   ] Got command RPT from MCS: ref #674406
2018-11-30 05:34:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674406  77 58452 20051177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:34:11 [DEBUG   ] Got command RPT from MCS: ref #674407
2018-11-30 05:34:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674407  12 58452 20051381 A  ERRORB–™š'
2018-11-30 05:34:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 05:34:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 05:35:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 05:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:35:09 [DEBUG   ] Finished updating board flags in 1.233 seconds
2018-11-30 05:35:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 05:35:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:35:49 [DEBUG   ] Got command RPT from MCS: ref #674416
2018-11-30 05:35:49 [DEBUG   ] summary = ERROR
2018-11-30 05:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674416  13 58452 20149917 A  ERRORERROR'
2018-11-30 05:35:49 [DEBUG   ] Got command RPT from MCS: ref #674417
2018-11-30 05:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674417  77 58452 20149918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:36:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:36:09 [DEBUG   ] Finished updating board flags in 1.178 seconds
2018-11-30 05:36:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:36:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:37:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:37:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 05:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 05:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:37:09 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-30 05:37:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:37:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:38:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:38:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:38:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:38:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:38:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:38:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:38:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:38:10 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-11-30 05:38:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:39:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:39:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:39:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:39:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:39:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:39:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:39:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:39:10 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-30 05:39:10 [DEBUG   ] Got command RPT from MCS: ref #674437
2018-11-30 05:39:10 [DEBUG   ] summary = ERROR
2018-11-30 05:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674437  13 58452 20350657 A  ERRORERROR'
2018-11-30 05:39:10 [DEBUG   ] Got command RPT from MCS: ref #674438
2018-11-30 05:39:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674438  77 58452 20350861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:39:11 [DEBUG   ] Got command RPT from MCS: ref #674439
2018-11-30 05:39:11 [DEBUG   ] summary = ERROR
2018-11-30 05:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674439  13 58452 20351065 A  ERRORERROR'
2018-11-30 05:39:11 [DEBUG   ] Got command RPT from MCS: ref #674440
2018-11-30 05:39:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674440  77 58452 20351269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:39:11 [DEBUG   ] Got command RPT from MCS: ref #674441
2018-11-30 05:39:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674441  12 58452 20351461 A  ERRORB˜™š'
2018-11-30 05:39:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:39:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:40:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 05:40:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:40:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:40:10 [DEBUG   ] Finished updating board flags in 1.251 seconds
2018-11-30 05:40:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 05:40:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:40:49 [DEBUG   ] Got command RPT from MCS: ref #674442
2018-11-30 05:40:49 [DEBUG   ] summary = ERROR
2018-11-30 05:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674442  13 58452 20449925 A  ERRORERROR'
2018-11-30 05:40:49 [DEBUG   ] Got command RPT from MCS: ref #674443
2018-11-30 05:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674443  77 58452 20449926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:41:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:41:10 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-30 05:41:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:41:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:42:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:42:11 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-30 05:42:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:42:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:43:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:43:10 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-30 05:43:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:43:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:44:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:44:10 [DEBUG   ] Got command RPT from MCS: ref #674465
2018-11-30 05:44:10 [DEBUG   ] summary = ERROR
2018-11-30 05:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674465  13 58452 20650749 A  ERRORERROR'
2018-11-30 05:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:44:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:44:10 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-11-30 05:44:10 [DEBUG   ] Got command RPT from MCS: ref #674466
2018-11-30 05:44:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:44:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674466  77 58452 20650953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:44:11 [DEBUG   ] Got command RPT from MCS: ref #674467
2018-11-30 05:44:11 [DEBUG   ] summary = ERROR
2018-11-30 05:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674467  13 58452 20651145 A  ERRORERROR'
2018-11-30 05:44:11 [DEBUG   ] Got command RPT from MCS: ref #674469
2018-11-30 05:44:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674469  77 58452 20651349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:44:11 [DEBUG   ] Got command RPT from MCS: ref #674470
2018-11-30 05:44:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674470  12 58452 20651553 A  ERRORB–™š'
2018-11-30 05:44:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:44:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:45:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:45:10 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-11-30 05:45:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:45:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:45:49 [DEBUG   ] Got command RPT from MCS: ref #674479
2018-11-30 05:45:49 [DEBUG   ] summary = ERROR
2018-11-30 05:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674479  13 58452 20749929 A  ERRORERROR'
2018-11-30 05:45:49 [DEBUG   ] Got command RPT from MCS: ref #674480
2018-11-30 05:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674480  77 58452 20749930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:46:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:46:11 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-11-30 05:46:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:46:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:47:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 05:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:47:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:47:11 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-11-30 05:47:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 05:47:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:48:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:48:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:48:10 [DEBUG   ] Finished updating board flags in 1.170 seconds
2018-11-30 05:48:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:48:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:49:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:49:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:49:10 [DEBUG   ] Got command RPT from MCS: ref #674500
2018-11-30 05:49:10 [DEBUG   ] summary = ERROR
2018-11-30 05:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674500  13 58452 20950837 A  ERRORERROR'
2018-11-30 05:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:49:10 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-30 05:49:11 [DEBUG   ] Got command RPT from MCS: ref #674501
2018-11-30 05:49:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674501  77 58452 20951029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:49:11 [DEBUG   ] Got command RPT from MCS: ref #674502
2018-11-30 05:49:11 [DEBUG   ] summary = ERROR
2018-11-30 05:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674502  13 58452 20951233 A  ERRORERROR'
2018-11-30 05:49:11 [DEBUG   ] Got command RPT from MCS: ref #674503
2018-11-30 05:49:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674503  77 58452 20951437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:49:11 [DEBUG   ] Got command RPT from MCS: ref #674504
2018-11-30 05:49:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674504  12 58452 20951641 A  ERRORB–™š'
2018-11-30 05:49:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:49:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:50:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:50:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 05:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 05:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:50:10 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-30 05:50:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:50:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:50:49 [DEBUG   ] Got command RPT from MCS: ref #674509
2018-11-30 05:50:49 [DEBUG   ] summary = ERROR
2018-11-30 05:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674509  13 58452 21049921 A  ERRORERROR'
2018-11-30 05:50:49 [DEBUG   ] Got command RPT from MCS: ref #674510
2018-11-30 05:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674510  77 58452 21049922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:51:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:51:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:51:11 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-11-30 05:51:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:51:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:52:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 05:52:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 05:52:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:52:11 [DEBUG   ] Finished updating board flags in 1.262 seconds
2018-11-30 05:52:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 05:52:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:53:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:53:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:53:11 [DEBUG   ] Finished updating board flags in 1.126 seconds
2018-11-30 05:53:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:53:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 05:54:10 [DEBUG   ] Got command RPT from MCS: ref #674532
2018-11-30 05:54:10 [DEBUG   ] summary = ERROR
2018-11-30 05:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674532  13 58452 21250917 A  ERRORERROR'
2018-11-30 05:54:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:54:11 [DEBUG   ] Got command RPT from MCS: ref #674533
2018-11-30 05:54:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:54:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674533  77 58452 21251121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:54:11 [DEBUG   ] Got command RPT from MCS: ref #674534
2018-11-30 05:54:11 [DEBUG   ] summary = ERROR
2018-11-30 05:54:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674534  13 58452 21251325 A  ERRORERROR'
2018-11-30 05:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:54:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:54:11 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-30 05:54:11 [DEBUG   ] Got command RPT from MCS: ref #674536
2018-11-30 05:54:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:54:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674536  77 58452 21251529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:54:11 [DEBUG   ] Got command RPT from MCS: ref #674538
2018-11-30 05:54:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 05:54:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674538  12 58452 21251721 A  ERRORB—™š'
2018-11-30 05:54:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:54:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:55:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 05:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 05:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:55:11 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-30 05:55:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:55:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:55:49 [DEBUG   ] Got command RPT from MCS: ref #674542
2018-11-30 05:55:49 [DEBUG   ] summary = ERROR
2018-11-30 05:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674542  13 58452 21349925 A  ERRORERROR'
2018-11-30 05:55:49 [DEBUG   ] Got command RPT from MCS: ref #674543
2018-11-30 05:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674543  77 58452 21349926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:56:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:56:12 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-30 05:56:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:56:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:57:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-30 05:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:57:12 [DEBUG   ] Finished updating board flags in 1.870 seconds
2018-11-30 05:57:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:57:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:58:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:58:11 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-30 05:58:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:58:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-30 05:59:00 [DEBUG   ] Got command RPT from MCS: ref #674563
2018-11-30 05:59:00 [DEBUG   ] summary = ERROR
2018-11-30 05:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674563  13 58452 21540269 A  ERRORERROR'
2018-11-30 05:59:00 [DEBUG   ] Got command RPT from MCS: ref #674564
2018-11-30 05:59:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 05:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674564  77 58452 21540270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 05:59:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 05:59:05 [DEBUG   ] Got command INI from MCS: ref #674565
2018-11-30 05:59:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-30 05:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   674565   8 58452 21545286 ABOOTING'
2018-11-30 05:59:11 [DEBUG   ] Got command RPT from MCS: ref #674566
2018-11-30 05:59:11 [DEBUG   ] summary = BOOTING
2018-11-30 05:59:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674566  15 58452 21551005 ABOOTINGBOOTING'
2018-11-30 05:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 05:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 05:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 05:59:11 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-30 05:59:25 [INFO    ] -------------------
2018-11-30 05:59:25 [INFO    ]  LWA board status
2018-11-30 05:59:25 [INFO    ] -------------------
2018-11-30 05:59:25 [INFO    ] DP 1: 2 lwa27
2018-11-30 05:59:25 [INFO    ] DP 1: 3 lwa24
2018-11-30 05:59:25 [INFO    ] DP 1: 4 lwa23
2018-11-30 05:59:25 [INFO    ] DP 1: 5 lwa18
2018-11-30 05:59:25 [INFO    ] DP 1: 6 lwa10
2018-11-30 05:59:25 [INFO    ] DP 1: 7 lwa32
2018-11-30 05:59:25 [INFO    ] DP 1: 8 lwa11
2018-11-30 05:59:25 [INFO    ] DP 1: 9 lwa30
2018-11-30 05:59:25 [INFO    ] DP 1: 10 lwa12
2018-11-30 05:59:25 [INFO    ] DP 1: 11 lwa8
2018-11-30 05:59:25 [INFO    ] DP 1: 12 lwa13
2018-11-30 05:59:25 [INFO    ] DP 1: 13 lwa26
2018-11-30 05:59:25 [INFO    ] DP 1: 14 lwa14
2018-11-30 05:59:25 [INFO    ] DP 1: 16 lwa22
2018-11-30 05:59:25 [INFO    ] DP 1: 17 lwa20
2018-11-30 05:59:25 [INFO    ] DP 1: 18 lwa1
2018-11-30 05:59:25 [INFO    ] DP 1: 19 lwa5
2018-11-30 05:59:25 [INFO    ] DP 1: 20 lwa25
2018-11-30 05:59:25 [INFO    ] DP 1: 21 lwa35
2018-11-30 05:59:25 [INFO    ] DP 1: 22 lwa19
2018-11-30 05:59:25 [INFO    ] DP 1: 23 lwa21
2018-11-30 05:59:25 [INFO    ] DP 1: 24 lwa6
2018-11-30 05:59:25 [INFO    ] DP 1: 25 lwa7
2018-11-30 05:59:25 [INFO    ] DP 1: 26 lwa33
2018-11-30 05:59:25 [INFO    ] DP 1: 27 lwa15
2018-11-30 05:59:25 [INFO    ] DP 1: 28 lwa28
2018-11-30 05:59:25 [INFO    ] DP 2: 1 lwa16
2018-11-30 05:59:25 [INFO    ] DP 2: 15 lwa34
2018-11-30 05:59:25 [INFO    ] Total of 28 boards
2018-11-30 05:59:25 [INFO    ] Total of 260 stands
2018-11-30 05:59:25 [INFO    ] -------------------
2018-11-30 05:59:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16687
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16688
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16689
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16690
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16691
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16692
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16693
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16694
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16695
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16696
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16697
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16698
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16699
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16700
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16701
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16702
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16703
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16704
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16705
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16706
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16707
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16708
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16709
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16710
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16711
2018-11-30 05:59:32 [DEBUG   ] 2018-11-30 05:59:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16712
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16687 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16688 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16689 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16690 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16691 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16692 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16693 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16694 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16695 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16696 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16697 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16698 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16699 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16700 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16701 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16702 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16703 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16704 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16705 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16706 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16707 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16708 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16709 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16710 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16711 exited with status 0
2018-11-30 05:59:44 [DEBUG   ] 2018-11-30 05:59:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16712 exited with status 0
2018-11-30 05:59:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:44 [DEBUG   ] spawn_process: at 2018-11-30 05:59:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-30 05:59:45 [DEBUG   ] 2018-11-30 05:59:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16739
2018-11-30 05:59:45 [DEBUG   ] 2018-11-30 05:59:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16740
2018-11-30 05:59:50 [DEBUG   ] 2018-11-30 05:59:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16739 exited with status 0
2018-11-30 05:59:50 [DEBUG   ] 2018-11-30 05:59:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16740 exited with status 0
2018-11-30 05:59:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-30 05:59:50 [DEBUG   ] spawn_process: at 2018-11-30 05:59:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-30 05:59:50 [DEBUG   ] spawn_process: at 2018-11-30 05:59:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-30 05:59:50 [INFO    ] Setting Beam 1 xbars
2018-11-30 05:59:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-30 05:59:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-30 05:59:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-30 05:59:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-30 05:59:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-30 05:59:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-30 05:59:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-30 05:59:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-30 05:59:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-30 05:59:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-30 05:59:55 [INFO    ] Setting Beam 2 xbars
2018-11-30 05:59:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-30 05:59:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-30 05:59:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-30 05:59:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-30 05:59:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-30 06:00:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-30 06:00:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-30 06:00:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-30 06:00:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-30 06:00:01 [INFO    ] Setting Beam 3 xbars
2018-11-30 06:00:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-30 06:00:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-30 06:00:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-30 06:00:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-30 06:00:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-30 06:00:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-30 06:00:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-30 06:00:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-30 06:00:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-30 06:00:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-30 06:00:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-30 06:00:06 [INFO    ] Setting Beam 4 xbars
2018-11-30 06:00:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-30 06:00:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-30 06:00:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-30 06:00:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-30 06:00:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-30 06:00:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-30 06:00:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-30 06:00:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-30 06:00:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-30 06:00:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-30 06:00:12 [INFO    ] All xbars set
2018-11-30 06:00:12 [INFO    ] Setting adder chain routing for all beams
2018-11-30 06:00:17 [INFO    ] Setting beam ids
2018-11-30 06:00:27 [INFO    ] Starting beam delay calibration
2018-11-30 06:00:39 [INFO    ] Beam 1 latency is 5716
2018-11-30 06:00:39 [INFO    ] Beam 2 latency is 5719
2018-11-30 06:00:39 [INFO    ] Beam 3 latency is 5733
2018-11-30 06:00:39 [INFO    ] Beam 4 latency is 5719
2018-11-30 06:00:39 [INFO    ] Stop calibration
2018-11-30 06:00:47 [INFO    ] Beam delay calibration successful
2018-11-30 06:00:47 [INFO    ] Calibration passed
2018-11-30 06:00:47 [DEBUG   ] spawn_process: at 2018-11-30 06:00:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-30 06:00:47 [DEBUG   ] spawn_process: at 2018-11-30 06:00:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-30 06:00:47 [DEBUG   ] spawn_process: at 2018-11-30 06:00:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-30 06:00:47 [DEBUG   ] spawn_process: at 2018-11-30 06:00:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-30 06:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-30 06:00:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 06:00:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 284 ms (1543557648.286 s) with PID 18340 and time 1543557649
2018-11-30 06:00:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-30 06:00:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 371 ms (1543557648.373 s) with PID 18343 and time 1543557649
2018-11-30 06:00:49 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2018-11-30 06:00:49 [INFO    ] Started antennas statistics background thread
2018-11-30 06:00:49 [INFO    ] Started board flags background thread
2018-11-30 06:00:49 [INFO    ] Started BAM background thread
2018-11-30 06:00:49 [INFO    ] Finished the INI process (ref. #674565) in 104.209 s
2018-11-30 06:00:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:00:49 [DEBUG   ] Got command RPT from MCS: ref #674571
2018-11-30 06:00:50 [DEBUG   ] summary = ERROR
2018-11-30 06:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674571  13 58452 21650291 A  ERRORERROR'
2018-11-30 06:00:50 [DEBUG   ] Got command RPT from MCS: ref #674572
2018-11-30 06:00:50 [DEBUG   ] info = Calibration passed
2018-11-30 06:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674572  26 58452 21650292 A  ERRORCalibration passed'
2018-11-30 06:00:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:00:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:00:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:00:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:00:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-30 06:00:50 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-30 06:01:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:01:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:01:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:01:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:01:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:01:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:01:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:01:50 [WARNING ] (13, 1, 'bot')
2018-11-30 06:01:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-30 06:01:50 [DEBUG   ] Finished updating board flags in 1.322 seconds
2018-11-30 06:02:05 [DEBUG   ] Got command RPT from MCS: ref #674588
2018-11-30 06:02:05 [DEBUG   ] summary = ERROR
2018-11-30 06:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674588  13 58452 21725285 A  ERRORERROR'
2018-11-30 06:02:05 [DEBUG   ] Got command RPT from MCS: ref #674589
2018-11-30 06:02:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674589  98 58452 21725286 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:02:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:02:10 [DEBUG   ] Got command INI from MCS: ref #674590
2018-11-30 06:02:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-30 06:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   674590   8 58452 21730294 ABOOTING'
2018-11-30 06:02:30 [INFO    ] -------------------
2018-11-30 06:02:30 [INFO    ]  LWA board status
2018-11-30 06:02:30 [INFO    ] -------------------
2018-11-30 06:02:30 [INFO    ] DP 1: 2 lwa27
2018-11-30 06:02:30 [INFO    ] DP 1: 3 lwa24
2018-11-30 06:02:30 [INFO    ] DP 1: 4 lwa23
2018-11-30 06:02:30 [INFO    ] DP 1: 5 lwa18
2018-11-30 06:02:30 [INFO    ] DP 1: 6 lwa10
2018-11-30 06:02:30 [INFO    ] DP 1: 7 lwa32
2018-11-30 06:02:30 [INFO    ] DP 1: 8 lwa11
2018-11-30 06:02:30 [INFO    ] DP 1: 9 lwa30
2018-11-30 06:02:30 [INFO    ] DP 1: 10 lwa12
2018-11-30 06:02:30 [INFO    ] DP 1: 11 lwa8
2018-11-30 06:02:30 [INFO    ] DP 1: 12 lwa13
2018-11-30 06:02:30 [INFO    ] DP 1: 13 lwa26
2018-11-30 06:02:30 [INFO    ] DP 1: 14 lwa14
2018-11-30 06:02:30 [INFO    ] DP 1: 16 lwa22
2018-11-30 06:02:30 [INFO    ] DP 1: 17 lwa20
2018-11-30 06:02:30 [INFO    ] DP 1: 18 lwa1
2018-11-30 06:02:30 [INFO    ] DP 1: 19 lwa5
2018-11-30 06:02:30 [INFO    ] DP 1: 20 lwa25
2018-11-30 06:02:30 [INFO    ] DP 1: 21 lwa35
2018-11-30 06:02:30 [INFO    ] DP 1: 22 lwa19
2018-11-30 06:02:30 [INFO    ] DP 1: 23 lwa21
2018-11-30 06:02:30 [INFO    ] DP 1: 24 lwa6
2018-11-30 06:02:30 [INFO    ] DP 1: 25 lwa7
2018-11-30 06:02:30 [INFO    ] DP 1: 26 lwa33
2018-11-30 06:02:30 [INFO    ] DP 1: 27 lwa15
2018-11-30 06:02:30 [INFO    ] DP 1: 28 lwa28
2018-11-30 06:02:30 [INFO    ] DP 2: 1 lwa16
2018-11-30 06:02:30 [INFO    ] DP 2: 15 lwa34
2018-11-30 06:02:30 [INFO    ] Total of 28 boards
2018-11-30 06:02:30 [INFO    ] Total of 260 stands
2018-11-30 06:02:30 [INFO    ] -------------------
2018-11-30 06:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18891
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18892
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18893
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18894
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18895
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18896
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18897
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18898
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18899
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18900
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18901
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18902
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18903
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18904
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18905
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18906
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18907
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18908
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18909
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18910
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18911
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18912
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18913
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18914
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18915
2018-11-30 06:02:37 [DEBUG   ] 2018-11-30 06:02:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18916
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18891 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18892 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18893 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18894 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18895 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18896 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18897 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18898 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18899 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18900 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18901 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18902 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18903 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18904 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18905 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18906 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18907 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18908 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18909 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18910 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18911 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18912 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18913 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18914 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18915 exited with status 0
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18916 exited with status 0
2018-11-30 06:02:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] spawn_process: at 2018-11-30 06:02:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18943
2018-11-30 06:02:50 [DEBUG   ] 2018-11-30 06:02:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18944
2018-11-30 06:02:55 [DEBUG   ] 2018-11-30 06:02:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18943 exited with status 0
2018-11-30 06:02:55 [DEBUG   ] 2018-11-30 06:02:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18944 exited with status 0
2018-11-30 06:02:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-30 06:02:55 [DEBUG   ] spawn_process: at 2018-11-30 06:02:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-30 06:02:55 [DEBUG   ] spawn_process: at 2018-11-30 06:02:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-30 06:02:55 [INFO    ] Setting Beam 1 xbars
2018-11-30 06:02:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-30 06:02:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-30 06:02:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-30 06:02:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-30 06:02:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-30 06:02:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-30 06:02:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-30 06:03:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-30 06:03:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-30 06:03:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-30 06:03:01 [INFO    ] Setting Beam 2 xbars
2018-11-30 06:03:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-30 06:03:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-30 06:03:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-30 06:03:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-30 06:03:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-30 06:03:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-30 06:03:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-30 06:03:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-30 06:03:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-30 06:03:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-30 06:03:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-30 06:03:06 [INFO    ] Setting Beam 3 xbars
2018-11-30 06:03:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-30 06:03:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-30 06:03:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-30 06:03:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-30 06:03:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-30 06:03:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-30 06:03:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-30 06:03:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-30 06:03:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-30 06:03:12 [INFO    ] Setting Beam 4 xbars
2018-11-30 06:03:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-30 06:03:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-30 06:03:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-30 06:03:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-30 06:03:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-30 06:03:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-30 06:03:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-30 06:03:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-30 06:03:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-30 06:03:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-30 06:03:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-30 06:03:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-30 06:03:17 [INFO    ] All xbars set
2018-11-30 06:03:17 [INFO    ] Setting adder chain routing for all beams
2018-11-30 06:03:22 [INFO    ] Setting beam ids
2018-11-30 06:03:32 [INFO    ] Starting beam delay calibration
2018-11-30 06:03:44 [INFO    ] Beam 1 latency is 5747
2018-11-30 06:03:44 [INFO    ] Beam 2 latency is 5764
2018-11-30 06:03:44 [INFO    ] Beam 3 latency is 5731
2018-11-30 06:03:44 [INFO    ] Beam 4 latency is 5751
2018-11-30 06:03:44 [INFO    ] Stop calibration
2018-11-30 06:03:52 [INFO    ] Beam delay calibration successful
2018-11-30 06:03:52 [INFO    ] Calibration passed
2018-11-30 06:03:52 [DEBUG   ] spawn_process: at 2018-11-30 06:03:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-30 06:03:52 [DEBUG   ] spawn_process: at 2018-11-30 06:03:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-30 06:03:52 [DEBUG   ] spawn_process: at 2018-11-30 06:03:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-30 06:03:52 [DEBUG   ] spawn_process: at 2018-11-30 06:03:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-30 06:03:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-30 06:03:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 06:03:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 295 ms (1543557833.296 s) with PID 20521 and time 1543557834
2018-11-30 06:03:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-30 06:03:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 384 ms (1543557833.386 s) with PID 20524 and time 1543557834
2018-11-30 06:03:54 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2018-11-30 06:03:54 [INFO    ] Started antennas statistics background thread
2018-11-30 06:03:54 [INFO    ] Started board flags background thread
2018-11-30 06:03:54 [INFO    ] Started BAM background thread
2018-11-30 06:03:54 [INFO    ] Finished the INI process (ref. #674590) in 104.217 s
2018-11-30 06:03:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:03:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:03:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:03:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:03:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:03:55 [DEBUG   ] Finished updating board flags in 1.041 seconds
2018-11-30 06:04:11 [DEBUG   ] Got command RPT from MCS: ref #674597
2018-11-30 06:04:11 [DEBUG   ] summary = ERROR
2018-11-30 06:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674597  13 58452 21851085 A  ERRORERROR'
2018-11-30 06:04:11 [DEBUG   ] Got command RPT from MCS: ref #674598
2018-11-30 06:04:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674598  77 58452 21851289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:04:11 [DEBUG   ] Got command RPT from MCS: ref #674599
2018-11-30 06:04:11 [DEBUG   ] summary = ERROR
2018-11-30 06:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674599  13 58452 21851493 A  ERRORERROR'
2018-11-30 06:04:11 [DEBUG   ] Got command RPT from MCS: ref #674601
2018-11-30 06:04:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674601  77 58452 21851697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:04:11 [DEBUG   ] Got command RPT from MCS: ref #674603
2018-11-30 06:04:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674603  12 58452 21851889 A  ERRORB”™š'
2018-11-30 06:04:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:04:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:04:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:04:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:04:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:04:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:04:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:04:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:04:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:04:55 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 06:05:10 [DEBUG   ] Got command RPT from MCS: ref #674607
2018-11-30 06:05:10 [DEBUG   ] summary = ERROR
2018-11-30 06:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674607  13 58452 21910289 A  ERRORERROR'
2018-11-30 06:05:10 [DEBUG   ] Got command RPT from MCS: ref #674608
2018-11-30 06:05:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674608  77 58452 21910290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:05:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:05:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:05:49 [DEBUG   ] Got command RPT from MCS: ref #674613
2018-11-30 06:05:49 [DEBUG   ] summary = ERROR
2018-11-30 06:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674613  13 58452 21949933 A  ERRORERROR'
2018-11-30 06:05:49 [DEBUG   ] Got command RPT from MCS: ref #674614
2018-11-30 06:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674614  77 58452 21949934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:05:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 06:05:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:05:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:05:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:05:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:05:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:05:55 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-11-30 06:06:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:06:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:06:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:06:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:06:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:06:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:06:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:06:56 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-30 06:07:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 06:07:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:07:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:07:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:07:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:07:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:07:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:07:55 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-11-30 06:08:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:08:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:08:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:08:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:08:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:08:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:08:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:08:55 [DEBUG   ] Finished updating board flags in 1.244 seconds
2018-11-30 06:09:11 [DEBUG   ] Got command RPT from MCS: ref #674634
2018-11-30 06:09:11 [DEBUG   ] summary = ERROR
2018-11-30 06:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674634  13 58452 22151181 A  ERRORERROR'
2018-11-30 06:09:11 [DEBUG   ] Got command RPT from MCS: ref #674635
2018-11-30 06:09:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674635  77 58452 22151373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:09:11 [DEBUG   ] Got command RPT from MCS: ref #674636
2018-11-30 06:09:11 [DEBUG   ] summary = ERROR
2018-11-30 06:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674636  13 58452 22151577 A  ERRORERROR'
2018-11-30 06:09:11 [DEBUG   ] Got command RPT from MCS: ref #674637
2018-11-30 06:09:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674637  77 58452 22151781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:09:11 [DEBUG   ] Got command RPT from MCS: ref #674638
2018-11-30 06:09:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674638  12 58452 22151985 A  ERRORB–™š'
2018-11-30 06:09:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:09:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 06:09:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 06:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:09:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:09:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:09:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:09:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:09:55 [DEBUG   ] Finished updating board flags in 1.163 seconds
2018-11-30 06:10:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:10:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:10:49 [DEBUG   ] Got command RPT from MCS: ref #674639
2018-11-30 06:10:49 [DEBUG   ] summary = ERROR
2018-11-30 06:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674639  13 58452 22249933 A  ERRORERROR'
2018-11-30 06:10:49 [DEBUG   ] Got command RPT from MCS: ref #674640
2018-11-30 06:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674640  77 58452 22249934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:10:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:10:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:10:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:10:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:10:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:10:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:10:55 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-30 06:11:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:11:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:11:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:11:55 [WARNING ] (13, 1, 'bot')
2018-11-30 06:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:11:55 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-11-30 06:12:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:12:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:12:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:12:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:12:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:12:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:12:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:12:56 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-11-30 06:13:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:13:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:13:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 06:13:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:13:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:13:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:13:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:13:56 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-30 06:14:11 [DEBUG   ] Got command RPT from MCS: ref #674662
2018-11-30 06:14:11 [DEBUG   ] summary = ERROR
2018-11-30 06:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674662  13 58452 22451257 A  ERRORERROR'
2018-11-30 06:14:11 [DEBUG   ] Got command RPT from MCS: ref #674663
2018-11-30 06:14:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674663  77 58452 22451461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:14:11 [DEBUG   ] Got command RPT from MCS: ref #674664
2018-11-30 06:14:11 [DEBUG   ] summary = ERROR
2018-11-30 06:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674664  13 58452 22451665 A  ERRORERROR'
2018-11-30 06:14:11 [DEBUG   ] Got command RPT from MCS: ref #674666
2018-11-30 06:14:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674666  77 58452 22451869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:14:12 [DEBUG   ] Got command RPT from MCS: ref #674667
2018-11-30 06:14:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674667  12 58452 22452061 A  ERRORB—™š'
2018-11-30 06:14:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 06:14:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:14:55 [DEBUG   ] Finished updating ant stats in 1.238 seconds
2018-11-30 06:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 06:14:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:14:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:14:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:14:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:14:56 [DEBUG   ] Finished updating board flags in 1.314 seconds
2018-11-30 06:15:15 [DEBUG   ] Finished updating ant stats in 1.166 seconds
2018-11-30 06:15:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:15:49 [DEBUG   ] Got command RPT from MCS: ref #674676
2018-11-30 06:15:49 [DEBUG   ] summary = ERROR
2018-11-30 06:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674676  13 58452 22549925 A  ERRORERROR'
2018-11-30 06:15:49 [DEBUG   ] Got command RPT from MCS: ref #674677
2018-11-30 06:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674677  77 58452 22549926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:15:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:15:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:15:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:15:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:15:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:15:56 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-30 06:16:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:16:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:16:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:16:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:16:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:16:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:16:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:16:56 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-30 06:17:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 06:17:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:17:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:17:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:17:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:17:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:17:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:17:56 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-30 06:18:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:18:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:18:55 [DEBUG   ] Finished updating ant stats in 0.782 seconds
2018-11-30 06:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:18:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:18:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:18:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:18:56 [WARNING ] (13, 1, 'bot')
2018-11-30 06:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:18:56 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-11-30 06:19:11 [DEBUG   ] Got command RPT from MCS: ref #674697
2018-11-30 06:19:11 [DEBUG   ] summary = ERROR
2018-11-30 06:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674697  13 58452 22751353 A  ERRORERROR'
2018-11-30 06:19:11 [DEBUG   ] Got command RPT from MCS: ref #674698
2018-11-30 06:19:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674698  77 58452 22751545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:19:11 [DEBUG   ] Got command RPT from MCS: ref #674699
2018-11-30 06:19:11 [DEBUG   ] summary = ERROR
2018-11-30 06:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674699  13 58452 22751749 A  ERRORERROR'
2018-11-30 06:19:11 [DEBUG   ] Got command RPT from MCS: ref #674700
2018-11-30 06:19:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674700  77 58452 22751953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:19:12 [DEBUG   ] Got command RPT from MCS: ref #674701
2018-11-30 06:19:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674701  12 58452 22752157 A  ERRORB–™š'
2018-11-30 06:19:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:19:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:19:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:19:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:19:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:19:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:19:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:19:57 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-30 06:19:58 [DEBUG   ] Got command DRX from MCS: ref #674704
2018-11-30 06:19:58 [INFO    ] sending drx command to lwa16
2018-11-30 06:19:58 [DEBUG   ] run_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 60000000.0 7 9 0']
2018-11-30 06:19:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-30 06:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   674704   8 58452 22798018 A  ERROR'
2018-11-30 06:19:58 [DEBUG   ] Got command DRX from MCS: ref #674705
2018-11-30 06:19:58 [INFO    ] sending drx command to lwa16
2018-11-30 06:19:58 [DEBUG   ] run_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 76000000.0 7 9 0']
2018-11-30 06:19:58 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-30 06:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   674705   8 58452 22798022 A  ERROR'
2018-11-30 06:19:58 [DEBUG   ] Got command BAM from MCS: ref #674706
2018-11-30 06:19:58 [INFO    ] Finished processing BAM request
2018-11-30 06:19:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674706   8 58452 22798025 A  ERROR'
2018-11-30 06:19:58 [INFO    ] Finished starting DRX
2018-11-30 06:19:58 [INFO    ] Finished starting DRX
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:19:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:19:58 [DEBUG   ] spawn_process: at 2018-11-30 06:19:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:20:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:20:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:20:37 [DEBUG   ] Got command BAM from MCS: ref #674712
2018-11-30 06:20:37 [INFO    ] Finished processing BAM request
2018-11-30 06:20:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674712   8 58452 22837033 A  ERROR'
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:20:37 [DEBUG   ] spawn_process: at 2018-11-30 06:20:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:20:49 [DEBUG   ] Got command RPT from MCS: ref #674713
2018-11-30 06:20:49 [DEBUG   ] summary = ERROR
2018-11-30 06:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674713  13 58452 22849937 A  ERRORERROR'
2018-11-30 06:20:49 [DEBUG   ] Got command RPT from MCS: ref #674714
2018-11-30 06:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674714  77 58452 22849938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:20:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 06:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:20:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:20:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:20:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:20:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:20:57 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-30 06:21:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:21:16 [DEBUG   ] Got command BAM from MCS: ref #674730
2018-11-30 06:21:16 [INFO    ] Finished processing BAM request
2018-11-30 06:21:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674730   8 58452 22876033 A  ERROR'
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:21:16 [DEBUG   ] spawn_process: at 2018-11-30 06:21:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:21:35 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 06:21:55 [DEBUG   ] Got command BAM from MCS: ref #674731
2018-11-30 06:21:55 [INFO    ] Finished processing BAM request
2018-11-30 06:21:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674731   8 58452 22915025 A  ERROR'
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:21:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:21:55 [DEBUG   ] spawn_process: at 2018-11-30 06:21:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:21:56 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2018-11-30 06:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:21:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 06:21:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:21:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:21:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:21:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:21:57 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-11-30 06:22:16 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2018-11-30 06:22:34 [DEBUG   ] Got command BAM from MCS: ref #674732
2018-11-30 06:22:34 [INFO    ] Finished processing BAM request
2018-11-30 06:22:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674732   8 58452 22954033 A  ERROR'
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:22:34 [DEBUG   ] spawn_process: at 2018-11-30 06:22:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:22:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:22:56 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2018-11-30 06:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:22:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:22:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:22:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:22:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:22:57 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-30 06:23:12 [DEBUG   ] Got command BAM from MCS: ref #674733
2018-11-30 06:23:12 [INFO    ] Finished processing BAM request
2018-11-30 06:23:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674733   8 58452 22992029 A  ERROR'
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:23:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:23:12 [DEBUG   ] spawn_process: at 2018-11-30 06:23:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:23:16 [DEBUG   ] Finished updating ant stats in 0.970 seconds
2018-11-30 06:23:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:23:50 [DEBUG   ] Got command BAM from MCS: ref #674739
2018-11-30 06:23:50 [INFO    ] Finished processing BAM request
2018-11-30 06:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674739   8 58452 23030029 A  ERROR'
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:23:50 [DEBUG   ] spawn_process: at 2018-11-30 06:23:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:23:56 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2018-11-30 06:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:23:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:23:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:23:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:23:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:23:57 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-30 06:24:11 [DEBUG   ] Got command RPT from MCS: ref #674741
2018-11-30 06:24:11 [DEBUG   ] summary = ERROR
2018-11-30 06:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674741  13 58452 23051429 A  ERRORERROR'
2018-11-30 06:24:11 [DEBUG   ] Got command RPT from MCS: ref #674742
2018-11-30 06:24:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674742  77 58452 23051633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:24:11 [DEBUG   ] Got command RPT from MCS: ref #674743
2018-11-30 06:24:11 [DEBUG   ] summary = ERROR
2018-11-30 06:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674743  13 58452 23051837 A  ERRORERROR'
2018-11-30 06:24:12 [DEBUG   ] Got command RPT from MCS: ref #674745
2018-11-30 06:24:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674745  77 58452 23052029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:24:12 [DEBUG   ] Got command RPT from MCS: ref #674747
2018-11-30 06:24:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674747  12 58452 23052233 A  ERRORB™™š'
2018-11-30 06:24:16 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-30 06:24:28 [DEBUG   ] Got command BAM from MCS: ref #674751
2018-11-30 06:24:28 [INFO    ] Finished processing BAM request
2018-11-30 06:24:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:24:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674751   8 58452 23068025 A  ERROR'
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:24:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:24:28 [DEBUG   ] spawn_process: at 2018-11-30 06:24:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:24:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:24:56 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2018-11-30 06:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:24:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:24:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:24:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:24:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:24:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-30 06:25:06 [DEBUG   ] Got command BAM from MCS: ref #674752
2018-11-30 06:25:06 [INFO    ] Finished processing BAM request
2018-11-30 06:25:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674752   8 58452 23106025 A  ERROR'
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:25:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:25:06 [DEBUG   ] spawn_process: at 2018-11-30 06:25:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:25:16 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-30 06:25:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:25:44 [DEBUG   ] Got command BAM from MCS: ref #674753
2018-11-30 06:25:44 [INFO    ] Finished processing BAM request
2018-11-30 06:25:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674753   8 58452 23144025 A  ERROR'
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:25:44 [DEBUG   ] spawn_process: at 2018-11-30 06:25:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:25:49 [DEBUG   ] Got command RPT from MCS: ref #674754
2018-11-30 06:25:49 [DEBUG   ] summary = ERROR
2018-11-30 06:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674754  13 58452 23149937 A  ERRORERROR'
2018-11-30 06:25:49 [DEBUG   ] Got command RPT from MCS: ref #674755
2018-11-30 06:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674755  77 58452 23149938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:25:56 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2018-11-30 06:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:25:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:25:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:25:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:25:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:25:57 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-30 06:26:16 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-30 06:26:22 [DEBUG   ] Got command BAM from MCS: ref #674771
2018-11-30 06:26:22 [INFO    ] Finished processing BAM request
2018-11-30 06:26:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674771   8 58452 23182033 A  ERROR'
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:26:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:26:22 [DEBUG   ] spawn_process: at 2018-11-30 06:26:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:26:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:26:57 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2018-11-30 06:26:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:26:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:26:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:26:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:26:57 [DEBUG   ] Finished updating board flags in 1.276 seconds
2018-11-30 06:27:00 [DEBUG   ] Got command BAM from MCS: ref #674776
2018-11-30 06:27:00 [INFO    ] Finished processing BAM request
2018-11-30 06:27:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674776   8 58452 23220029 A  ERROR'
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:27:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:27:00 [DEBUG   ] spawn_process: at 2018-11-30 06:27:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:27:17 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-11-30 06:27:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:27:38 [DEBUG   ] Got command BAM from MCS: ref #674777
2018-11-30 06:27:38 [INFO    ] Finished processing BAM request
2018-11-30 06:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674777   8 58452 23258029 A  ERROR'
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:27:38 [DEBUG   ] spawn_process: at 2018-11-30 06:27:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:27:57 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-30 06:27:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:27:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:27:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:27:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:27:57 [DEBUG   ] Finished updating board flags in 1.195 seconds
2018-11-30 06:28:16 [DEBUG   ] Got command BAM from MCS: ref #674778
2018-11-30 06:28:16 [INFO    ] Finished processing BAM request
2018-11-30 06:28:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674778   8 58452 23296033 A  ERROR'
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:28:16 [DEBUG   ] spawn_process: at 2018-11-30 06:28:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:28:17 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-30 06:28:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:28:54 [DEBUG   ] Got command BAM from MCS: ref #674779
2018-11-30 06:28:54 [INFO    ] Finished processing BAM request
2018-11-30 06:28:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:28:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674779   8 58452 23334033 A  ERROR'
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:28:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:28:54 [DEBUG   ] spawn_process: at 2018-11-30 06:28:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:28:57 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-11-30 06:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:28:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:28:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:28:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:28:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:28:58 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-11-30 06:29:11 [DEBUG   ] Got command RPT from MCS: ref #674780
2018-11-30 06:29:11 [DEBUG   ] summary = ERROR
2018-11-30 06:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674780  13 58452 23351521 A  ERRORERROR'
2018-11-30 06:29:11 [DEBUG   ] Got command RPT from MCS: ref #674781
2018-11-30 06:29:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674781  77 58452 23351725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:29:11 [DEBUG   ] Got command RPT from MCS: ref #674782
2018-11-30 06:29:11 [DEBUG   ] summary = ERROR
2018-11-30 06:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674782  13 58452 23351917 A  ERRORERROR'
2018-11-30 06:29:12 [DEBUG   ] Got command RPT from MCS: ref #674783
2018-11-30 06:29:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674783  77 58452 23352121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:29:12 [DEBUG   ] Got command RPT from MCS: ref #674784
2018-11-30 06:29:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674784  12 58452 23352325 A  ERRORBœ™š'
2018-11-30 06:29:17 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2018-11-30 06:29:32 [DEBUG   ] Got command BAM from MCS: ref #674789
2018-11-30 06:29:32 [INFO    ] Finished processing BAM request
2018-11-30 06:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674789   8 58452 23372025 A  ERROR'
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:29:32 [DEBUG   ] spawn_process: at 2018-11-30 06:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:29:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:29:57 [DEBUG   ] Finished updating ant stats in 0.626 seconds
2018-11-30 06:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 06:29:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:29:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:29:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:29:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:29:58 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-30 06:30:10 [DEBUG   ] Got command BAM from MCS: ref #674790
2018-11-30 06:30:10 [INFO    ] Finished processing BAM request
2018-11-30 06:30:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674790   8 58452 23410029 A  ERROR'
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:30:10 [DEBUG   ] spawn_process: at 2018-11-30 06:30:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:30:17 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-30 06:30:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:30:47 [DEBUG   ] Got command BAM from MCS: ref #674791
2018-11-30 06:30:47 [INFO    ] Finished processing BAM request
2018-11-30 06:30:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:30:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674791   8 58452 23447025 A  ERROR'
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:30:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:30:47 [DEBUG   ] spawn_process: at 2018-11-30 06:30:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:30:49 [DEBUG   ] Got command RPT from MCS: ref #674792
2018-11-30 06:30:49 [DEBUG   ] summary = ERROR
2018-11-30 06:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674792  13 58452 23449933 A  ERRORERROR'
2018-11-30 06:30:49 [DEBUG   ] Got command RPT from MCS: ref #674793
2018-11-30 06:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674793  77 58452 23449934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:30:57 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-11-30 06:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:30:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:30:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:30:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:30:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:30:58 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-30 06:31:17 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-30 06:31:24 [DEBUG   ] Got command BAM from MCS: ref #674809
2018-11-30 06:31:24 [INFO    ] Finished processing BAM request
2018-11-30 06:31:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674809   8 58452 23484025 A  ERROR'
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:31:24 [DEBUG   ] spawn_process: at 2018-11-30 06:31:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:31:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:31:58 [DEBUG   ] Finished updating ant stats in 1.225 seconds
2018-11-30 06:31:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:31:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:31:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:31:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:31:58 [DEBUG   ] Finished updating board flags in 1.671 seconds
2018-11-30 06:32:01 [DEBUG   ] Got command BAM from MCS: ref #674810
2018-11-30 06:32:01 [INFO    ] Finished processing BAM request
2018-11-30 06:32:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674810   8 58452 23521033 A  ERROR'
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:32:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:32:01 [DEBUG   ] spawn_process: at 2018-11-30 06:32:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:32:18 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-11-30 06:32:38 [DEBUG   ] Got command BAM from MCS: ref #674815
2018-11-30 06:32:38 [INFO    ] Finished processing BAM request
2018-11-30 06:32:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674815   8 58452 23558025 A  ERROR'
2018-11-30 06:32:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:32:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:32:38 [DEBUG   ] spawn_process: at 2018-11-30 06:32:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 06:32:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:32:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:32:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:32:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:32:57 [WARNING ] (13, 1, 'bot')
2018-11-30 06:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:32:57 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-30 06:32:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:33:15 [DEBUG   ] Got command BAM from MCS: ref #674816
2018-11-30 06:33:15 [INFO    ] Finished processing BAM request
2018-11-30 06:33:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674816   8 58452 23595033 A  ERROR'
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:33:15 [DEBUG   ] spawn_process: at 2018-11-30 06:33:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:33:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:33:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 06:33:52 [DEBUG   ] Got command BAM from MCS: ref #674819
2018-11-30 06:33:52 [INFO    ] Finished processing BAM request
2018-11-30 06:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674819   8 58452 23632029 A  ERROR'
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:33:52 [DEBUG   ] spawn_process: at 2018-11-30 06:33:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:33:58 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-11-30 06:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 06:33:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:33:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:33:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:33:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:33:58 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-30 06:34:11 [DEBUG   ] Got command RPT from MCS: ref #674820
2018-11-30 06:34:11 [DEBUG   ] summary = ERROR
2018-11-30 06:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674820  13 58452 23651601 A  ERRORERROR'
2018-11-30 06:34:11 [DEBUG   ] Got command RPT from MCS: ref #674821
2018-11-30 06:34:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674821  77 58452 23651805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:34:12 [DEBUG   ] Got command RPT from MCS: ref #674822
2018-11-30 06:34:12 [DEBUG   ] summary = ERROR
2018-11-30 06:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674822  13 58452 23652009 A  ERRORERROR'
2018-11-30 06:34:12 [DEBUG   ] Got command RPT from MCS: ref #674824
2018-11-30 06:34:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674824  77 58452 23652213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:34:12 [DEBUG   ] Got command RPT from MCS: ref #674826
2018-11-30 06:34:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674826  12 58452 23652405 A  ERRORBœ™š'
2018-11-30 06:34:18 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-30 06:34:29 [DEBUG   ] Got command BAM from MCS: ref #674830
2018-11-30 06:34:29 [INFO    ] Finished processing BAM request
2018-11-30 06:34:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674830   8 58452 23669029 A  ERROR'
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:34:30 [DEBUG   ] spawn_process: at 2018-11-30 06:34:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:34:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 06:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:34:58 [DEBUG   ] Finished updating ant stats in 0.624 seconds
2018-11-30 06:34:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:34:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:34:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:34:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:34:58 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-30 06:35:06 [DEBUG   ] Got command BAM from MCS: ref #674831
2018-11-30 06:35:06 [INFO    ] Finished processing BAM request
2018-11-30 06:35:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674831   8 58452 23706037 A  ERROR'
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:35:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:35:06 [DEBUG   ] spawn_process: at 2018-11-30 06:35:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:35:18 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-30 06:35:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:35:43 [DEBUG   ] Got command BAM from MCS: ref #674836
2018-11-30 06:35:43 [INFO    ] Finished processing BAM request
2018-11-30 06:35:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:35:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674836   8 58452 23743029 A  ERROR'
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:35:43 [DEBUG   ] spawn_process: at 2018-11-30 06:35:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:35:49 [DEBUG   ] Got command RPT from MCS: ref #674837
2018-11-30 06:35:49 [DEBUG   ] summary = ERROR
2018-11-30 06:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674837  13 58452 23749941 A  ERRORERROR'
2018-11-30 06:35:49 [DEBUG   ] Got command RPT from MCS: ref #674838
2018-11-30 06:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674838  77 58452 23749942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:35:58 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-11-30 06:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 06:35:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:35:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:35:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:35:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:35:58 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-30 06:36:18 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-30 06:36:20 [DEBUG   ] Got command BAM from MCS: ref #674854
2018-11-30 06:36:20 [INFO    ] Finished processing BAM request
2018-11-30 06:36:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674854   8 58452 23780025 A  ERROR'
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:36:20 [DEBUG   ] spawn_process: at 2018-11-30 06:36:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:36:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:36:57 [DEBUG   ] Got command BAM from MCS: ref #674855
2018-11-30 06:36:57 [INFO    ] Finished processing BAM request
2018-11-30 06:36:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674855   8 58452 23817029 A  ERROR'
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:36:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:36:57 [DEBUG   ] spawn_process: at 2018-11-30 06:36:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:36:59 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2018-11-30 06:36:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:36:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:36:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:36:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:36:59 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-11-30 06:37:19 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-11-30 06:37:34 [DEBUG   ] Got command BAM from MCS: ref #674856
2018-11-30 06:37:34 [INFO    ] Finished processing BAM request
2018-11-30 06:37:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674856   8 58452 23854025 A  ERROR'
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:37:34 [DEBUG   ] spawn_process: at 2018-11-30 06:37:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:37:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:37:59 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-30 06:37:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:37:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:37:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:37:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:37:59 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-11-30 06:38:11 [DEBUG   ] Got command BAM from MCS: ref #674857
2018-11-30 06:38:11 [INFO    ] Finished processing BAM request
2018-11-30 06:38:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674857   8 58452 23891033 A  ERROR'
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:38:11 [DEBUG   ] spawn_process: at 2018-11-30 06:38:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:38:19 [DEBUG   ] Finished updating ant stats in 0.967 seconds
2018-11-30 06:38:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:38:48 [DEBUG   ] Got command BAM from MCS: ref #674862
2018-11-30 06:38:48 [INFO    ] Finished processing BAM request
2018-11-30 06:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674862   8 58452 23928026 A  ERROR'
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:38:48 [DEBUG   ] spawn_process: at 2018-11-30 06:38:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:38:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:38:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:38:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:38:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:38:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:38:58 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-11-30 06:38:59 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-30 06:39:11 [DEBUG   ] Got command RPT from MCS: ref #674863
2018-11-30 06:39:11 [DEBUG   ] summary = ERROR
2018-11-30 06:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674863  13 58452 23951690 A  ERRORERROR'
2018-11-30 06:39:11 [DEBUG   ] Got command RPT from MCS: ref #674864
2018-11-30 06:39:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674864  77 58452 23951894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:39:12 [DEBUG   ] Got command RPT from MCS: ref #674865
2018-11-30 06:39:12 [DEBUG   ] summary = ERROR
2018-11-30 06:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674865  13 58452 23952097 A  ERRORERROR'
2018-11-30 06:39:12 [DEBUG   ] Got command RPT from MCS: ref #674866
2018-11-30 06:39:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674866  77 58452 23952301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:39:12 [DEBUG   ] Got command RPT from MCS: ref #674867
2018-11-30 06:39:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674867  12 58452 23952494 A  ERRORB›™š'
2018-11-30 06:39:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:39:25 [DEBUG   ] Got command BAM from MCS: ref #674868
2018-11-30 06:39:25 [INFO    ] Finished processing BAM request
2018-11-30 06:39:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674868   8 58452 23965346 A  ERROR'
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:39:25 [DEBUG   ] spawn_process: at 2018-11-30 06:39:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:39:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:39:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:39:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:39:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:39:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:39:58 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-30 06:39:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:40:02 [DEBUG   ] Got command BAM from MCS: ref #674869
2018-11-30 06:40:02 [INFO    ] Finished processing BAM request
2018-11-30 06:40:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674869   8 58452 24002034 A  ERROR'
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:40:02 [DEBUG   ] spawn_process: at 2018-11-30 06:40:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:40:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 06:40:39 [DEBUG   ] Got command BAM from MCS: ref #674870
2018-11-30 06:40:39 [INFO    ] Finished processing BAM request
2018-11-30 06:40:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:40:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674870   8 58452 24039029 A  ERROR'
2018-11-30 06:40:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:40:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:40:39 [DEBUG   ] spawn_process: at 2018-11-30 06:40:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:40:40 [DEBUG   ] spawn_process: at 2018-11-30 06:40:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:40:49 [DEBUG   ] Got command RPT from MCS: ref #674871
2018-11-30 06:40:49 [DEBUG   ] summary = ERROR
2018-11-30 06:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674871  13 58452 24049941 A  ERRORERROR'
2018-11-30 06:40:49 [DEBUG   ] Got command RPT from MCS: ref #674872
2018-11-30 06:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674872  77 58452 24049942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:40:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:40:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:40:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:40:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:40:58 [DEBUG   ] Finished updating board flags in 1.245 seconds
2018-11-30 06:40:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-30 06:41:16 [DEBUG   ] Got command BAM from MCS: ref #674888
2018-11-30 06:41:16 [INFO    ] Finished processing BAM request
2018-11-30 06:41:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674888   8 58452 24076029 A  ERROR'
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:41:16 [DEBUG   ] spawn_process: at 2018-11-30 06:41:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:41:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:41:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:41:53 [DEBUG   ] Got command BAM from MCS: ref #674893
2018-11-30 06:41:53 [INFO    ] Finished processing BAM request
2018-11-30 06:41:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674893   8 58452 24113025 A  ERROR'
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:41:53 [DEBUG   ] spawn_process: at 2018-11-30 06:41:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 06:41:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:41:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:41:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:41:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:41:58 [DEBUG   ] Finished updating board flags in 1.083 seconds
2018-11-30 06:41:59 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 06:42:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:42:29 [DEBUG   ] Got command BAM from MCS: ref #674894
2018-11-30 06:42:29 [INFO    ] Finished processing BAM request
2018-11-30 06:42:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674894   8 58452 24149033 A  ERROR'
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:42:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:42:29 [DEBUG   ] spawn_process: at 2018-11-30 06:42:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:42:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 06:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:42:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:42:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:42:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:42:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:42:59 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-11-30 06:43:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:43:05 [DEBUG   ] Got command BAM from MCS: ref #674895
2018-11-30 06:43:05 [INFO    ] Finished processing BAM request
2018-11-30 06:43:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674895   8 58452 24185045 A  ERROR'
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:43:05 [DEBUG   ] spawn_process: at 2018-11-30 06:43:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:43:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:43:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:43:41 [DEBUG   ] Got command BAM from MCS: ref #674896
2018-11-30 06:43:41 [INFO    ] Finished processing BAM request
2018-11-30 06:43:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:43:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674896   8 58452 24221033 A  ERROR'
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:43:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:43:41 [DEBUG   ] spawn_process: at 2018-11-30 06:43:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:43:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:43:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:43:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:43:58 [WARNING ] (13, 1, 'bot')
2018-11-30 06:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:43:58 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-30 06:44:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:44:11 [DEBUG   ] Got command RPT from MCS: ref #674899
2018-11-30 06:44:11 [DEBUG   ] summary = ERROR
2018-11-30 06:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674899  13 58452 24251773 A  ERRORERROR'
2018-11-30 06:44:11 [DEBUG   ] Got command RPT from MCS: ref #674900
2018-11-30 06:44:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674900  77 58452 24251977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:44:12 [DEBUG   ] Got command RPT from MCS: ref #674901
2018-11-30 06:44:12 [DEBUG   ] summary = ERROR
2018-11-30 06:44:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674901  13 58452 24252181 A  ERRORERROR'
2018-11-30 06:44:12 [DEBUG   ] Got command RPT from MCS: ref #674903
2018-11-30 06:44:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:44:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674903  77 58452 24252396 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:44:12 [DEBUG   ] Got command RPT from MCS: ref #674904
2018-11-30 06:44:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:44:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674904  12 58452 24252585 A  ERRORBš™š'
2018-11-30 06:44:17 [DEBUG   ] Got command BAM from MCS: ref #674909
2018-11-30 06:44:17 [INFO    ] Finished processing BAM request
2018-11-30 06:44:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674909   8 58452 24257033 A  ERROR'
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:44:17 [DEBUG   ] spawn_process: at 2018-11-30 06:44:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:44:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:44:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:44:53 [DEBUG   ] Got command BAM from MCS: ref #674914
2018-11-30 06:44:53 [INFO    ] Finished processing BAM request
2018-11-30 06:44:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674914   8 58452 24293029 A  ERROR'
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:44:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:44:53 [DEBUG   ] spawn_process: at 2018-11-30 06:44:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:44:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 06:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 06:45:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 06:45:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:45:00 [DEBUG   ] Finished updating board flags in 2.298 seconds
2018-11-30 06:45:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 06:45:29 [DEBUG   ] Got command BAM from MCS: ref #674915
2018-11-30 06:45:29 [INFO    ] Finished processing BAM request
2018-11-30 06:45:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674915   8 58452 24329029 A  ERROR'
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:45:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:45:29 [DEBUG   ] spawn_process: at 2018-11-30 06:45:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:45:41 [DEBUG   ] Finished updating ant stats in 1.282 seconds
2018-11-30 06:45:49 [DEBUG   ] Got command RPT from MCS: ref #674916
2018-11-30 06:45:49 [DEBUG   ] summary = ERROR
2018-11-30 06:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674916  13 58452 24349945 A  ERRORERROR'
2018-11-30 06:45:49 [DEBUG   ] Got command RPT from MCS: ref #674917
2018-11-30 06:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674917  77 58452 24349946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 06:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:45:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:45:59 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-11-30 06:46:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:46:05 [DEBUG   ] Got command BAM from MCS: ref #674933
2018-11-30 06:46:05 [INFO    ] Finished processing BAM request
2018-11-30 06:46:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674933   8 58452 24365025 A  ERROR'
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:46:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:46:05 [DEBUG   ] spawn_process: at 2018-11-30 06:46:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:46:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 06:46:41 [DEBUG   ] Got command BAM from MCS: ref #674934
2018-11-30 06:46:41 [INFO    ] Finished processing BAM request
2018-11-30 06:46:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674934   8 58452 24401033 A  ERROR'
2018-11-30 06:46:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:46:41 [DEBUG   ] spawn_process: at 2018-11-30 06:46:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:46:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:46:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:46:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:46:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:46:59 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-30 06:47:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 06:47:17 [DEBUG   ] Got command BAM from MCS: ref #674935
2018-11-30 06:47:17 [INFO    ] Finished processing BAM request
2018-11-30 06:47:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:47:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674935   8 58452 24437029 A  ERROR'
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:47:17 [DEBUG   ] spawn_process: at 2018-11-30 06:47:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:47:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 06:47:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:47:53 [DEBUG   ] Got command BAM from MCS: ref #674940
2018-11-30 06:47:53 [INFO    ] Finished processing BAM request
2018-11-30 06:47:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:47:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674940   8 58452 24473033 A  ERROR'
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:47:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:47:53 [DEBUG   ] spawn_process: at 2018-11-30 06:47:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:47:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:47:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:47:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:47:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:47:59 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 06:48:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 06:48:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 06:48:29 [DEBUG   ] Got command BAM from MCS: ref #674941
2018-11-30 06:48:29 [INFO    ] Finished processing BAM request
2018-11-30 06:48:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674941   8 58452 24509033 A  ERROR'
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:48:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:48:29 [DEBUG   ] spawn_process: at 2018-11-30 06:48:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:48:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 06:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:48:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:48:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:48:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:48:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:48:59 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-11-30 06:49:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 06:49:05 [DEBUG   ] Got command BAM from MCS: ref #674942
2018-11-30 06:49:05 [INFO    ] Finished processing BAM request
2018-11-30 06:49:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674942   8 58452 24545033 A  ERROR'
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:49:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:49:05 [DEBUG   ] spawn_process: at 2018-11-30 06:49:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:49:11 [DEBUG   ] Got command RPT from MCS: ref #674943
2018-11-30 06:49:11 [DEBUG   ] summary = ERROR
2018-11-30 06:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674943  13 58452 24551869 A  ERRORERROR'
2018-11-30 06:49:12 [DEBUG   ] Got command RPT from MCS: ref #674944
2018-11-30 06:49:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:49:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674944  77 58452 24552073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:49:12 [DEBUG   ] Got command RPT from MCS: ref #674945
2018-11-30 06:49:12 [DEBUG   ] summary = ERROR
2018-11-30 06:49:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674945  13 58452 24552265 A  ERRORERROR'
2018-11-30 06:49:12 [DEBUG   ] Got command RPT from MCS: ref #674946
2018-11-30 06:49:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:49:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674946  77 58452 24552469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:49:12 [DEBUG   ] Got command RPT from MCS: ref #674947
2018-11-30 06:49:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:49:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674947  12 58452 24552673 A  ERRORBœ™š'
2018-11-30 06:49:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 06:49:41 [DEBUG   ] Got command BAM from MCS: ref #674948
2018-11-30 06:49:41 [INFO    ] Finished processing BAM request
2018-11-30 06:49:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674948   8 58452 24581033 A  ERROR'
2018-11-30 06:49:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:49:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:49:41 [DEBUG   ] spawn_process: at 2018-11-30 06:49:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:49:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 06:49:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:49:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:49:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:49:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:49:59 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-30 06:50:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:50:17 [DEBUG   ] Got command BAM from MCS: ref #674949
2018-11-30 06:50:17 [INFO    ] Finished processing BAM request
2018-11-30 06:50:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674949   8 58452 24617029 A  ERROR'
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:50:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:50:17 [DEBUG   ] spawn_process: at 2018-11-30 06:50:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:50:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 06:50:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:50:49 [DEBUG   ] Got command RPT from MCS: ref #674954
2018-11-30 06:50:49 [DEBUG   ] summary = ERROR
2018-11-30 06:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674954  13 58452 24649937 A  ERRORERROR'
2018-11-30 06:50:49 [DEBUG   ] Got command RPT from MCS: ref #674955
2018-11-30 06:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674955  77 58452 24649938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:50:53 [DEBUG   ] Got command BAM from MCS: ref #674971
2018-11-30 06:50:53 [INFO    ] Finished processing BAM request
2018-11-30 06:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674971   8 58452 24653025 A  ERROR'
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:50:53 [DEBUG   ] spawn_process: at 2018-11-30 06:50:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:50:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:50:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:50:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:50:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:50:59 [DEBUG   ] Finished updating board flags in 1.250 seconds
2018-11-30 06:51:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:51:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:51:29 [DEBUG   ] Got command BAM from MCS: ref #674972
2018-11-30 06:51:29 [INFO    ] Finished processing BAM request
2018-11-30 06:51:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674972   8 58452 24689025 A  ERROR'
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:51:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:51:29 [DEBUG   ] spawn_process: at 2018-11-30 06:51:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:51:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:52:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:52:00 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 06:52:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 06:52:05 [DEBUG   ] Got command BAM from MCS: ref #674973
2018-11-30 06:52:05 [INFO    ] Finished processing BAM request
2018-11-30 06:52:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674973   8 58452 24725029 A  ERROR'
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:52:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:52:05 [DEBUG   ] spawn_process: at 2018-11-30 06:52:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:52:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:52:41 [DEBUG   ] Got command BAM from MCS: ref #674974
2018-11-30 06:52:41 [INFO    ] Finished processing BAM request
2018-11-30 06:52:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674974   8 58452 24761033 A  ERROR'
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:52:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:52:41 [DEBUG   ] spawn_process: at 2018-11-30 06:52:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:52:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 06:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:53:00 [DEBUG   ] Finished updating board flags in 1.741 seconds
2018-11-30 06:53:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 06:53:17 [DEBUG   ] Got command BAM from MCS: ref #674975
2018-11-30 06:53:17 [INFO    ] Finished processing BAM request
2018-11-30 06:53:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674975   8 58452 24797025 A  ERROR'
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:53:17 [DEBUG   ] spawn_process: at 2018-11-30 06:53:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:53:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 06:53:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 06:53:53 [DEBUG   ] Got command BAM from MCS: ref #674982
2018-11-30 06:53:53 [INFO    ] Finished processing BAM request
2018-11-30 06:53:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674982   8 58452 24833025 A  ERROR'
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:53:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:53:53 [DEBUG   ] spawn_process: at 2018-11-30 06:53:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:53:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 06:53:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:53:59 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-30 06:54:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 06:54:11 [DEBUG   ] Got command RPT from MCS: ref #674983
2018-11-30 06:54:11 [DEBUG   ] summary = ERROR
2018-11-30 06:54:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674983  13 58452 24851953 A  ERRORERROR'
2018-11-30 06:54:12 [DEBUG   ] Got command RPT from MCS: ref #674984
2018-11-30 06:54:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674984  77 58452 24852157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:54:12 [DEBUG   ] Got command RPT from MCS: ref #674985
2018-11-30 06:54:12 [DEBUG   ] summary = ERROR
2018-11-30 06:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674985  13 58452 24852349 A  ERRORERROR'
2018-11-30 06:54:12 [DEBUG   ] Got command RPT from MCS: ref #674987
2018-11-30 06:54:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674987  77 58452 24852553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:54:12 [DEBUG   ] Got command RPT from MCS: ref #674988
2018-11-30 06:54:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674988  12 58452 24852757 A  ERRORBœ™š'
2018-11-30 06:54:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:54:29 [DEBUG   ] Got command BAM from MCS: ref #674993
2018-11-30 06:54:29 [INFO    ] Finished processing BAM request
2018-11-30 06:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674993   8 58452 24869025 A  ERROR'
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:54:30 [DEBUG   ] spawn_process: at 2018-11-30 06:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:54:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 06:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 06:54:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:54:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:54:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:54:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:54:59 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-11-30 06:55:02 [DEBUG   ] Finished updating ant stats in 0.615 seconds
2018-11-30 06:55:05 [DEBUG   ] Got command BAM from MCS: ref #674994
2018-11-30 06:55:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674994   8 58452 24905146 A  ERROR'
2018-11-30 06:55:05 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-30 06:55:05 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-30 06:55:05 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-30 06:55:05 [DEBUG   ] 
2018-11-30 06:55:05 [INFO    ] Finished processing BAM request
2018-11-30 06:55:22 [DEBUG   ] Finished updating ant stats in 0.382 seconds
2018-11-30 06:55:41 [DEBUG   ] Got command BAM from MCS: ref #674995
2018-11-30 06:55:41 [INFO    ] Finished processing BAM request
2018-11-30 06:55:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:55:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   674995   8 58452 24941034 A  ERROR'
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:55:41 [DEBUG   ] spawn_process: at 2018-11-30 06:55:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:55:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:55:49 [DEBUG   ] Got command RPT from MCS: ref #674996
2018-11-30 06:55:49 [DEBUG   ] summary = ERROR
2018-11-30 06:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674996  13 58452 24949938 A  ERRORERROR'
2018-11-30 06:55:49 [DEBUG   ] Got command RPT from MCS: ref #674997
2018-11-30 06:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674997  77 58452 24949938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 06:55:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:55:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:55:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:55:59 [WARNING ] (13, 1, 'bot')
2018-11-30 06:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:55:59 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-11-30 06:56:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:56:17 [DEBUG   ] Got command BAM from MCS: ref #675013
2018-11-30 06:56:17 [INFO    ] Finished processing BAM request
2018-11-30 06:56:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675013   8 58452 24977026 A  ERROR'
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 06:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 06:56:17 [DEBUG   ] spawn_process: at 2018-11-30 06:56:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 06:56:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:56:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:56:53 [DEBUG   ] Got command BAM from MCS: ref #675018
2018-11-30 06:56:53 [INFO    ] Finished processing BAM request
2018-11-30 06:56:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675018   8 58452 25013030 A  ERROR'
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:56:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:56:53 [DEBUG   ] spawn_process: at 2018-11-30 06:56:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:57:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:57:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:57:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:57:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:57:00 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-30 06:57:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:57:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 06:57:29 [DEBUG   ] Got command BAM from MCS: ref #675019
2018-11-30 06:57:29 [INFO    ] Finished processing BAM request
2018-11-30 06:57:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675019   8 58452 25049034 A  ERROR'
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 06:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 06:57:30 [DEBUG   ] spawn_process: at 2018-11-30 06:57:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 06:57:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 06:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 06:58:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:58:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:58:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:58:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:58:00 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-30 06:58:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 06:58:05 [DEBUG   ] Got command BAM from MCS: ref #675020
2018-11-30 06:58:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675020   8 58452 25085250 A  ERROR'
2018-11-30 06:58:05 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-30 06:58:05 [INFO    ] Finished processing BAM request
2018-11-30 06:58:05 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-30 06:58:05 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-30 06:58:05 [DEBUG   ] 
2018-11-30 06:58:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 06:58:41 [DEBUG   ] Got command BAM from MCS: ref #675021
2018-11-30 06:58:41 [INFO    ] Finished processing BAM request
2018-11-30 06:58:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675021   8 58452 25121026 A  ERROR'
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 06:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 06:58:41 [DEBUG   ] spawn_process: at 2018-11-30 06:58:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 06:58:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 06:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 06:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 06:59:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:59:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:59:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:59:00 [WARNING ] (13, 1, 'bot')
2018-11-30 06:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 06:59:00 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-30 06:59:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 06:59:12 [DEBUG   ] Got command RPT from MCS: ref #675022
2018-11-30 06:59:12 [DEBUG   ] summary = ERROR
2018-11-30 06:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675022  13 58452 25152052 A  ERRORERROR'
2018-11-30 06:59:12 [DEBUG   ] Got command RPT from MCS: ref #675023
2018-11-30 06:59:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675023  77 58452 25152241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:59:12 [DEBUG   ] Got command RPT from MCS: ref #675024
2018-11-30 06:59:12 [DEBUG   ] summary = ERROR
2018-11-30 06:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675024  13 58452 25152445 A  ERRORERROR'
2018-11-30 06:59:12 [DEBUG   ] Got command RPT from MCS: ref #675025
2018-11-30 06:59:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 06:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675025  77 58452 25152638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 06:59:12 [DEBUG   ] Got command RPT from MCS: ref #675026
2018-11-30 06:59:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 06:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675026  12 58452 25152841 A  ERRORBš™š'
2018-11-30 06:59:17 [DEBUG   ] Got command BAM from MCS: ref #675027
2018-11-30 06:59:17 [INFO    ] Finished processing BAM request
2018-11-30 06:59:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675027   8 58452 25157034 A  ERROR'
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 06:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 06:59:17 [DEBUG   ] spawn_process: at 2018-11-30 06:59:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 06:59:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 06:59:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 06:59:53 [DEBUG   ] Got command BAM from MCS: ref #675032
2018-11-30 06:59:53 [INFO    ] Finished processing BAM request
2018-11-30 06:59:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 06:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675032   8 58452 25193029 A  ERROR'
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 06:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 06:59:53 [DEBUG   ] spawn_process: at 2018-11-30 06:59:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 06:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:00:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:00:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:00:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:00:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:00:00 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-11-30 07:00:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:00:23 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 07:00:29 [DEBUG   ] Got command BAM from MCS: ref #675033
2018-11-30 07:00:29 [INFO    ] Finished processing BAM request
2018-11-30 07:00:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675033   8 58452 25229025 A  ERROR'
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:00:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:00:31 [DEBUG   ] spawn_process: at 2018-11-30 07:00:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:00:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:00:49 [DEBUG   ] Got command RPT from MCS: ref #675034
2018-11-30 07:00:49 [DEBUG   ] summary = ERROR
2018-11-30 07:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675034  13 58452 25249949 A  ERRORERROR'
2018-11-30 07:00:49 [DEBUG   ] Got command RPT from MCS: ref #675035
2018-11-30 07:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675035  77 58452 25249950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:01:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:01:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:01:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:01:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:01:00 [DEBUG   ] Finished updating board flags in 1.274 seconds
2018-11-30 07:01:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:01:05 [DEBUG   ] Got command BAM from MCS: ref #675051
2018-11-30 07:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675051   8 58452 25265253 A  ERROR'
2018-11-30 07:01:05 [INFO    ] Finished processing BAM request
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:01:05 [DEBUG   ] spawn_process: at 2018-11-30 07:01:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:01:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:01:41 [DEBUG   ] Got command BAM from MCS: ref #675052
2018-11-30 07:01:41 [INFO    ] Finished processing BAM request
2018-11-30 07:01:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675052   8 58452 25301033 A  ERROR'
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:01:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:01:41 [DEBUG   ] spawn_process: at 2018-11-30 07:01:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:01:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:02:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:02:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:02:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:02:00 [WARNING ] (13, 1, 'bot')
2018-11-30 07:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:02:00 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-30 07:02:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:02:17 [DEBUG   ] Got command BAM from MCS: ref #675053
2018-11-30 07:02:17 [INFO    ] Finished processing BAM request
2018-11-30 07:02:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675053   8 58452 25337049 A  ERROR'
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:02:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:02:17 [DEBUG   ] spawn_process: at 2018-11-30 07:02:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:02:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:02:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:02:53 [DEBUG   ] Got command BAM from MCS: ref #675058
2018-11-30 07:02:53 [INFO    ] Finished processing BAM request
2018-11-30 07:02:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:02:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675058   8 58452 25373025 A  ERROR'
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:02:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:02:53 [DEBUG   ] spawn_process: at 2018-11-30 07:02:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:03:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 07:03:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:03:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:03:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:03:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:03:01 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-11-30 07:03:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:03:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:03:29 [DEBUG   ] Got command BAM from MCS: ref #675059
2018-11-30 07:03:29 [INFO    ] Finished processing BAM request
2018-11-30 07:03:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675059   8 58452 25409025 A  ERROR'
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:03:29 [DEBUG   ] spawn_process: at 2018-11-30 07:03:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:03:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 07:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:04:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:04:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:04:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:04:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:04:01 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-11-30 07:04:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:04:05 [DEBUG   ] Got command BAM from MCS: ref #675062
2018-11-30 07:04:05 [INFO    ] Finished processing BAM request
2018-11-30 07:04:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675062   8 58452 25445029 A  ERROR'
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:04:05 [DEBUG   ] spawn_process: at 2018-11-30 07:04:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:04:12 [DEBUG   ] Got command RPT from MCS: ref #675063
2018-11-30 07:04:12 [DEBUG   ] summary = ERROR
2018-11-30 07:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675063  13 58452 25452129 A  ERRORERROR'
2018-11-30 07:04:12 [DEBUG   ] Got command RPT from MCS: ref #675064
2018-11-30 07:04:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675064  77 58452 25452321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:04:12 [DEBUG   ] Got command RPT from MCS: ref #675065
2018-11-30 07:04:12 [DEBUG   ] summary = ERROR
2018-11-30 07:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675065  13 58452 25452525 A  ERRORERROR'
2018-11-30 07:04:12 [DEBUG   ] Got command RPT from MCS: ref #675067
2018-11-30 07:04:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675067  77 58452 25452729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:04:12 [DEBUG   ] Got command RPT from MCS: ref #675069
2018-11-30 07:04:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675069  12 58452 25452921 A  ERRORB›™š'
2018-11-30 07:04:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:04:41 [DEBUG   ] Got command BAM from MCS: ref #675073
2018-11-30 07:04:41 [INFO    ] Finished processing BAM request
2018-11-30 07:04:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675073   8 58452 25481033 A  ERROR'
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:04:41 [DEBUG   ] spawn_process: at 2018-11-30 07:04:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:04:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:05:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:05:01 [DEBUG   ] Finished updating board flags in 1.308 seconds
2018-11-30 07:05:03 [DEBUG   ] Finished updating ant stats in 0.617 seconds
2018-11-30 07:05:17 [DEBUG   ] Got command BAM from MCS: ref #675074
2018-11-30 07:05:17 [INFO    ] Finished processing BAM request
2018-11-30 07:05:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675074   8 58452 25517033 A  ERROR'
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:05:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:05:17 [DEBUG   ] spawn_process: at 2018-11-30 07:05:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:05:23 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2018-11-30 07:05:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:05:49 [DEBUG   ] Got command RPT from MCS: ref #675079
2018-11-30 07:05:49 [DEBUG   ] summary = ERROR
2018-11-30 07:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675079  13 58452 25549945 A  ERRORERROR'
2018-11-30 07:05:49 [DEBUG   ] Got command RPT from MCS: ref #675080
2018-11-30 07:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675080  77 58452 25549946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:05:53 [DEBUG   ] Got command BAM from MCS: ref #675096
2018-11-30 07:05:53 [INFO    ] Finished processing BAM request
2018-11-30 07:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675096   8 58452 25553033 A  ERROR'
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:05:53 [DEBUG   ] spawn_process: at 2018-11-30 07:05:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 07:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:06:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:06:01 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-30 07:06:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:06:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:06:29 [DEBUG   ] Got command BAM from MCS: ref #675097
2018-11-30 07:06:29 [INFO    ] Finished processing BAM request
2018-11-30 07:06:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675097   8 58452 25589025 A  ERROR'
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:06:29 [DEBUG   ] spawn_process: at 2018-11-30 07:06:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:06:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 07:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 07:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:07:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:07:01 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-30 07:07:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:07:05 [DEBUG   ] Got command BAM from MCS: ref #675098
2018-11-30 07:07:05 [INFO    ] Finished processing BAM request
2018-11-30 07:07:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:07:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675098   8 58452 25625033 A  ERROR'
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:07:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:07:05 [DEBUG   ] spawn_process: at 2018-11-30 07:07:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:07:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:07:42 [DEBUG   ] Got command BAM from MCS: ref #675099
2018-11-30 07:07:42 [INFO    ] Finished processing BAM request
2018-11-30 07:07:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675099   8 58452 25662033 A  ERROR'
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:07:42 [DEBUG   ] spawn_process: at 2018-11-30 07:07:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:07:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 07:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:08:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:08:01 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-11-30 07:08:03 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 07:08:19 [DEBUG   ] Got command BAM from MCS: ref #675100
2018-11-30 07:08:19 [INFO    ] Finished processing BAM request
2018-11-30 07:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675100   8 58452 25699025 A  ERROR'
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:08:19 [DEBUG   ] spawn_process: at 2018-11-30 07:08:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:08:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 07:08:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:08:56 [DEBUG   ] Got command BAM from MCS: ref #675105
2018-11-30 07:08:56 [INFO    ] Finished processing BAM request
2018-11-30 07:08:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675105   8 58452 25736033 A  ERROR'
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:08:56 [DEBUG   ] spawn_process: at 2018-11-30 07:08:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:09:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:09:01 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-30 07:09:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:09:12 [DEBUG   ] Got command RPT from MCS: ref #675106
2018-11-30 07:09:12 [DEBUG   ] summary = ERROR
2018-11-30 07:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675106  13 58452 25752209 A  ERRORERROR'
2018-11-30 07:09:12 [DEBUG   ] Got command RPT from MCS: ref #675107
2018-11-30 07:09:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675107  77 58452 25752413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:09:12 [DEBUG   ] Got command RPT from MCS: ref #675108
2018-11-30 07:09:12 [DEBUG   ] summary = ERROR
2018-11-30 07:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675108  13 58452 25752617 A  ERRORERROR'
2018-11-30 07:09:12 [DEBUG   ] Got command RPT from MCS: ref #675109
2018-11-30 07:09:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675109  77 58452 25752809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:09:13 [DEBUG   ] Got command RPT from MCS: ref #675110
2018-11-30 07:09:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675110  12 58452 25753013 A  ERRORBœ™š'
2018-11-30 07:09:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:09:33 [DEBUG   ] Got command BAM from MCS: ref #675111
2018-11-30 07:09:33 [INFO    ] Finished processing BAM request
2018-11-30 07:09:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:09:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675111   8 58452 25773033 A  ERROR'
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:09:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:09:33 [DEBUG   ] spawn_process: at 2018-11-30 07:09:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:09:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:10:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:10:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:10:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:10:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:10:01 [DEBUG   ] Finished updating board flags in 1.043 seconds
2018-11-30 07:10:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:10:10 [DEBUG   ] Got command BAM from MCS: ref #675112
2018-11-30 07:10:10 [INFO    ] Finished processing BAM request
2018-11-30 07:10:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675112   8 58452 25810025 A  ERROR'
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:10:10 [DEBUG   ] spawn_process: at 2018-11-30 07:10:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:10:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:10:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:10:47 [DEBUG   ] Got command BAM from MCS: ref #675113
2018-11-30 07:10:47 [INFO    ] Finished processing BAM request
2018-11-30 07:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675113   8 58452 25847029 A  ERROR'
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:10:47 [DEBUG   ] spawn_process: at 2018-11-30 07:10:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:10:49 [DEBUG   ] Got command RPT from MCS: ref #675114
2018-11-30 07:10:49 [DEBUG   ] summary = ERROR
2018-11-30 07:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675114  13 58452 25849945 A  ERRORERROR'
2018-11-30 07:10:49 [DEBUG   ] Got command RPT from MCS: ref #675115
2018-11-30 07:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675115  77 58452 25849946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 07:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:11:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:11:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:11:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:11:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:11:01 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-30 07:11:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:11:24 [DEBUG   ] Got command BAM from MCS: ref #675131
2018-11-30 07:11:24 [INFO    ] Finished processing BAM request
2018-11-30 07:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675131   8 58452 25884029 A  ERROR'
2018-11-30 07:11:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:11:24 [DEBUG   ] spawn_process: at 2018-11-30 07:11:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:11:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:12:01 [DEBUG   ] Got command BAM from MCS: ref #675136
2018-11-30 07:12:01 [INFO    ] Finished processing BAM request
2018-11-30 07:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675136   8 58452 25921025 A  ERROR'
2018-11-30 07:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:12:01 [DEBUG   ] spawn_process: at 2018-11-30 07:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:12:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:12:02 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-11-30 07:12:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:12:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:12:38 [DEBUG   ] Got command BAM from MCS: ref #675137
2018-11-30 07:12:38 [INFO    ] Finished processing BAM request
2018-11-30 07:12:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675137   8 58452 25958029 A  ERROR'
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:12:38 [DEBUG   ] spawn_process: at 2018-11-30 07:12:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:12:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:13:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:13:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:13:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:13:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:13:01 [DEBUG   ] Finished updating board flags in 1.240 seconds
2018-11-30 07:13:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:13:15 [DEBUG   ] Got command BAM from MCS: ref #675138
2018-11-30 07:13:15 [INFO    ] Finished processing BAM request
2018-11-30 07:13:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675138   8 58452 25995029 A  ERROR'
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:13:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:13:15 [DEBUG   ] spawn_process: at 2018-11-30 07:13:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:13:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:13:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:13:52 [DEBUG   ] Got command BAM from MCS: ref #675141
2018-11-30 07:13:52 [INFO    ] Finished processing BAM request
2018-11-30 07:13:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:13:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675141   8 58452 26032029 A  ERROR'
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:13:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:13:52 [DEBUG   ] spawn_process: at 2018-11-30 07:13:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 07:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:14:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:14:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:14:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:14:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:14:01 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-30 07:14:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:14:12 [DEBUG   ] Got command RPT from MCS: ref #675142
2018-11-30 07:14:12 [DEBUG   ] summary = ERROR
2018-11-30 07:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675142  13 58452 26052297 A  ERRORERROR'
2018-11-30 07:14:12 [DEBUG   ] Got command RPT from MCS: ref #675143
2018-11-30 07:14:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675143  77 58452 26052501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:14:12 [DEBUG   ] Got command RPT from MCS: ref #675144
2018-11-30 07:14:12 [DEBUG   ] summary = ERROR
2018-11-30 07:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675144  13 58452 26052693 A  ERRORERROR'
2018-11-30 07:14:12 [DEBUG   ] Got command RPT from MCS: ref #675146
2018-11-30 07:14:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:14:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675146  77 58452 26052897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:14:13 [DEBUG   ] Got command RPT from MCS: ref #675147
2018-11-30 07:14:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675147  12 58452 26053101 A  ERRORB›™š'
2018-11-30 07:14:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 07:14:29 [DEBUG   ] Got command BAM from MCS: ref #675156
2018-11-30 07:14:29 [INFO    ] Finished processing BAM request
2018-11-30 07:14:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675156   8 58452 26069025 A  ERROR'
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:14:29 [DEBUG   ] spawn_process: at 2018-11-30 07:14:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:14:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:15:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:15:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:15:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:15:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:15:01 [DEBUG   ] Finished updating board flags in 1.260 seconds
2018-11-30 07:15:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 07:15:06 [DEBUG   ] Got command BAM from MCS: ref #675157
2018-11-30 07:15:06 [INFO    ] Finished processing BAM request
2018-11-30 07:15:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675157   8 58452 26106025 A  ERROR'
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:15:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:15:06 [DEBUG   ] spawn_process: at 2018-11-30 07:15:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:15:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 07:15:43 [DEBUG   ] Got command BAM from MCS: ref #675158
2018-11-30 07:15:43 [INFO    ] Finished processing BAM request
2018-11-30 07:15:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:15:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675158   8 58452 26143025 A  ERROR'
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:15:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:15:43 [DEBUG   ] spawn_process: at 2018-11-30 07:15:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:15:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:15:49 [DEBUG   ] Got command RPT from MCS: ref #675159
2018-11-30 07:15:49 [DEBUG   ] summary = ERROR
2018-11-30 07:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675159  13 58452 26149941 A  ERRORERROR'
2018-11-30 07:15:49 [DEBUG   ] Got command RPT from MCS: ref #675160
2018-11-30 07:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675160  77 58452 26149942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:16:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:16:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:16:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:16:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:16:01 [DEBUG   ] Finished updating board flags in 1.136 seconds
2018-11-30 07:16:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:16:20 [DEBUG   ] Got command BAM from MCS: ref #675176
2018-11-30 07:16:20 [INFO    ] Finished processing BAM request
2018-11-30 07:16:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675176   8 58452 26180033 A  ERROR'
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:16:20 [DEBUG   ] spawn_process: at 2018-11-30 07:16:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:16:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:16:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:16:57 [DEBUG   ] Got command BAM from MCS: ref #675177
2018-11-30 07:16:57 [INFO    ] Finished processing BAM request
2018-11-30 07:16:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675177   8 58452 26217029 A  ERROR'
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:16:57 [DEBUG   ] spawn_process: at 2018-11-30 07:16:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:17:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:17:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:17:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:17:01 [WARNING ] (13, 1, 'bot')
2018-11-30 07:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:17:01 [DEBUG   ] Finished updating board flags in 1.099 seconds
2018-11-30 07:17:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:17:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:17:34 [DEBUG   ] Got command BAM from MCS: ref #675182
2018-11-30 07:17:34 [INFO    ] Finished processing BAM request
2018-11-30 07:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675182   8 58452 26254029 A  ERROR'
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:17:34 [DEBUG   ] spawn_process: at 2018-11-30 07:17:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:17:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:18:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:18:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:18:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:18:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:18:02 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-11-30 07:18:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:18:11 [DEBUG   ] Got command BAM from MCS: ref #675183
2018-11-30 07:18:11 [INFO    ] Finished processing BAM request
2018-11-30 07:18:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675183   8 58452 26291025 A  ERROR'
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:18:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:18:11 [DEBUG   ] spawn_process: at 2018-11-30 07:18:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:18:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:18:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:18:49 [DEBUG   ] Got command BAM from MCS: ref #675184
2018-11-30 07:18:49 [INFO    ] Finished processing BAM request
2018-11-30 07:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675184   8 58452 26329029 A  ERROR'
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:18:49 [DEBUG   ] spawn_process: at 2018-11-30 07:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:19:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:19:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:19:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:19:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:19:02 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-30 07:19:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 07:19:12 [DEBUG   ] Got command RPT from MCS: ref #675185
2018-11-30 07:19:12 [DEBUG   ] summary = ERROR
2018-11-30 07:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675185  13 58452 26352377 A  ERRORERROR'
2018-11-30 07:19:12 [DEBUG   ] Got command RPT from MCS: ref #675186
2018-11-30 07:19:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675186  77 58452 26352581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:19:12 [DEBUG   ] Got command RPT from MCS: ref #675187
2018-11-30 07:19:12 [DEBUG   ] summary = ERROR
2018-11-30 07:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675187  13 58452 26352785 A  ERRORERROR'
2018-11-30 07:19:12 [DEBUG   ] Got command RPT from MCS: ref #675188
2018-11-30 07:19:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675188  77 58452 26352989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:19:13 [DEBUG   ] Got command RPT from MCS: ref #675189
2018-11-30 07:19:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675189  12 58452 26353181 A  ERRORB›™š'
2018-11-30 07:19:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 07:19:27 [DEBUG   ] Got command BAM from MCS: ref #675190
2018-11-30 07:19:27 [INFO    ] Finished processing BAM request
2018-11-30 07:19:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675190   8 58452 26367033 A  ERROR'
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:19:27 [DEBUG   ] spawn_process: at 2018-11-30 07:19:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:19:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 07:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:20:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:20:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:20:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:20:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:20:02 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-30 07:20:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-30 07:20:05 [DEBUG   ] Got command BAM from MCS: ref #675191
2018-11-30 07:20:05 [INFO    ] Finished processing BAM request
2018-11-30 07:20:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675191   8 58452 26405033 A  ERROR'
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:20:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:20:05 [DEBUG   ] spawn_process: at 2018-11-30 07:20:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:20:24 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-30 07:20:43 [DEBUG   ] Got command BAM from MCS: ref #675196
2018-11-30 07:20:43 [INFO    ] Finished processing BAM request
2018-11-30 07:20:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:20:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675196   8 58452 26443025 A  ERROR'
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:20:43 [DEBUG   ] spawn_process: at 2018-11-30 07:20:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:20:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 07:20:49 [DEBUG   ] Got command RPT from MCS: ref #675197
2018-11-30 07:20:49 [DEBUG   ] summary = ERROR
2018-11-30 07:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675197  13 58452 26449941 A  ERRORERROR'
2018-11-30 07:20:49 [DEBUG   ] Got command RPT from MCS: ref #675198
2018-11-30 07:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675198  77 58452 26449942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:21:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:21:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:21:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:21:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:21:02 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-30 07:21:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:21:21 [DEBUG   ] Got command BAM from MCS: ref #675214
2018-11-30 07:21:21 [INFO    ] Finished processing BAM request
2018-11-30 07:21:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675214   8 58452 26481033 A  ERROR'
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:21:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:21:21 [DEBUG   ] spawn_process: at 2018-11-30 07:21:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:21:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 07:21:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:21:59 [DEBUG   ] Got command BAM from MCS: ref #675215
2018-11-30 07:21:59 [INFO    ] Finished processing BAM request
2018-11-30 07:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675215   8 58452 26519033 A  ERROR'
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:21:59 [DEBUG   ] spawn_process: at 2018-11-30 07:21:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:22:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:22:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:22:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:22:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:22:02 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 07:22:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:22:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:22:37 [DEBUG   ] Got command BAM from MCS: ref #675216
2018-11-30 07:22:37 [INFO    ] Finished processing BAM request
2018-11-30 07:22:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675216   8 58452 26557029 A  ERROR'
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:22:37 [DEBUG   ] spawn_process: at 2018-11-30 07:22:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:22:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-30 07:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:23:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:23:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:23:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:23:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:23:02 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-11-30 07:23:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:23:15 [DEBUG   ] Got command BAM from MCS: ref #675217
2018-11-30 07:23:15 [INFO    ] Finished processing BAM request
2018-11-30 07:23:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675217   8 58452 26595033 A  ERROR'
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:23:15 [DEBUG   ] spawn_process: at 2018-11-30 07:23:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:23:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:23:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:23:53 [DEBUG   ] Got command BAM from MCS: ref #675224
2018-11-30 07:23:53 [INFO    ] Finished processing BAM request
2018-11-30 07:23:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:23:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675224   8 58452 26633025 A  ERROR'
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:23:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:23:53 [DEBUG   ] spawn_process: at 2018-11-30 07:23:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:24:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:24:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:24:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:24:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:24:02 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-11-30 07:24:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:24:12 [DEBUG   ] Got command RPT from MCS: ref #675225
2018-11-30 07:24:12 [DEBUG   ] summary = ERROR
2018-11-30 07:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675225  13 58452 26652461 A  ERRORERROR'
2018-11-30 07:24:12 [DEBUG   ] Got command RPT from MCS: ref #675226
2018-11-30 07:24:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675226  77 58452 26652665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:24:12 [DEBUG   ] Got command RPT from MCS: ref #675227
2018-11-30 07:24:12 [DEBUG   ] summary = ERROR
2018-11-30 07:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675227  13 58452 26652869 A  ERRORERROR'
2018-11-30 07:24:13 [DEBUG   ] Got command RPT from MCS: ref #675229
2018-11-30 07:24:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675229  77 58452 26653073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:24:13 [DEBUG   ] Got command RPT from MCS: ref #675231
2018-11-30 07:24:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675231  12 58452 26653265 A  ERRORBœ™š'
2018-11-30 07:24:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:24:31 [DEBUG   ] Got command BAM from MCS: ref #675235
2018-11-30 07:24:31 [INFO    ] Finished processing BAM request
2018-11-30 07:24:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:24:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675235   8 58452 26671029 A  ERROR'
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:24:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:24:31 [DEBUG   ] spawn_process: at 2018-11-30 07:24:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:24:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:25:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 07:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:25:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:25:03 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-11-30 07:25:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:25:09 [DEBUG   ] Got command BAM from MCS: ref #675236
2018-11-30 07:25:09 [INFO    ] Finished processing BAM request
2018-11-30 07:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675236   8 58452 26709033 A  ERROR'
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:25:09 [DEBUG   ] spawn_process: at 2018-11-30 07:25:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:25:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:25:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:25:47 [DEBUG   ] Got command BAM from MCS: ref #675237
2018-11-30 07:25:47 [INFO    ] Finished processing BAM request
2018-11-30 07:25:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:25:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675237   8 58452 26747029 A  ERROR'
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:25:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:25:47 [DEBUG   ] spawn_process: at 2018-11-30 07:25:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:25:49 [DEBUG   ] Got command RPT from MCS: ref #675238
2018-11-30 07:25:49 [DEBUG   ] summary = ERROR
2018-11-30 07:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675238  13 58452 26749945 A  ERRORERROR'
2018-11-30 07:25:49 [DEBUG   ] Got command RPT from MCS: ref #675239
2018-11-30 07:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675239  77 58452 26749946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 07:26:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:26:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:26:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:26:02 [WARNING ] (13, 1, 'bot')
2018-11-30 07:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:26:02 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-11-30 07:26:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:26:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:26:26 [DEBUG   ] Got command BAM from MCS: ref #675258
2018-11-30 07:26:26 [INFO    ] Finished processing BAM request
2018-11-30 07:26:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675258   8 58452 26786033 A  ERROR'
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:26:26 [DEBUG   ] spawn_process: at 2018-11-30 07:26:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:26:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 07:27:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:27:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:27:03 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-11-30 07:27:05 [DEBUG   ] Got command BAM from MCS: ref #675260
2018-11-30 07:27:05 [INFO    ] Finished processing BAM request
2018-11-30 07:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675260   8 58452 26825025 A  ERROR'
2018-11-30 07:27:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:27:05 [DEBUG   ] spawn_process: at 2018-11-30 07:27:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:27:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:27:44 [DEBUG   ] Got command BAM from MCS: ref #675261
2018-11-30 07:27:44 [INFO    ] Finished processing BAM request
2018-11-30 07:27:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:27:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675261   8 58452 26864033 A  ERROR'
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:27:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:27:44 [DEBUG   ] spawn_process: at 2018-11-30 07:27:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:27:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:28:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:28:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:28:03 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-30 07:28:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:28:23 [DEBUG   ] Got command BAM from MCS: ref #675262
2018-11-30 07:28:23 [INFO    ] Finished processing BAM request
2018-11-30 07:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675262   8 58452 26903029 A  ERROR'
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:28:23 [DEBUG   ] spawn_process: at 2018-11-30 07:28:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:28:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:28:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:29:02 [DEBUG   ] Got command BAM from MCS: ref #675263
2018-11-30 07:29:02 [INFO    ] Finished processing BAM request
2018-11-30 07:29:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675263   8 58452 26942025 A  ERROR'
2018-11-30 07:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:29:02 [DEBUG   ] spawn_process: at 2018-11-30 07:29:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:29:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:29:03 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-30 07:29:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:29:12 [DEBUG   ] Got command RPT from MCS: ref #675264
2018-11-30 07:29:12 [DEBUG   ] summary = ERROR
2018-11-30 07:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675264  13 58452 26952549 A  ERRORERROR'
2018-11-30 07:29:12 [DEBUG   ] Got command RPT from MCS: ref #675265
2018-11-30 07:29:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675265  77 58452 26952753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:29:12 [DEBUG   ] Got command RPT from MCS: ref #675266
2018-11-30 07:29:12 [DEBUG   ] summary = ERROR
2018-11-30 07:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675266  13 58452 26952957 A  ERRORERROR'
2018-11-30 07:29:13 [DEBUG   ] Got command RPT from MCS: ref #675267
2018-11-30 07:29:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675267  77 58452 26953161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:29:13 [DEBUG   ] Got command RPT from MCS: ref #675268
2018-11-30 07:29:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675268  12 58452 26953353 A  ERRORBœ™š'
2018-11-30 07:29:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:29:41 [DEBUG   ] Got command BAM from MCS: ref #675273
2018-11-30 07:29:41 [INFO    ] Finished processing BAM request
2018-11-30 07:29:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675273   8 58452 26981041 A  ERROR'
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:29:41 [DEBUG   ] spawn_process: at 2018-11-30 07:29:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:29:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 07:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:30:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:30:03 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-30 07:30:05 [DEBUG   ] Finished updating ant stats in 0.673 seconds
2018-11-30 07:30:20 [DEBUG   ] Got command BAM from MCS: ref #675274
2018-11-30 07:30:20 [INFO    ] Finished processing BAM request
2018-11-30 07:30:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:30:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675274   8 58452 27020025 A  ERROR'
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:30:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:30:20 [DEBUG   ] spawn_process: at 2018-11-30 07:30:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:30:25 [DEBUG   ] Finished updating ant stats in 0.530 seconds
2018-11-30 07:30:46 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 07:30:49 [DEBUG   ] Got command RPT from MCS: ref #675275
2018-11-30 07:30:49 [DEBUG   ] summary = ERROR
2018-11-30 07:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675275  13 58452 27049945 A  ERRORERROR'
2018-11-30 07:30:49 [DEBUG   ] Got command RPT from MCS: ref #675276
2018-11-30 07:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675276  77 58452 27049946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:30:59 [DEBUG   ] Got command BAM from MCS: ref #675292
2018-11-30 07:30:59 [INFO    ] Finished processing BAM request
2018-11-30 07:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675292   8 58452 27059033 A  ERROR'
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:30:59 [DEBUG   ] spawn_process: at 2018-11-30 07:30:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 07:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-30 07:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:31:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:31:03 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-11-30 07:31:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:31:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:31:38 [DEBUG   ] Got command BAM from MCS: ref #675293
2018-11-30 07:31:38 [INFO    ] Finished processing BAM request
2018-11-30 07:31:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675293   8 58452 27098025 A  ERROR'
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:31:38 [DEBUG   ] spawn_process: at 2018-11-30 07:31:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:31:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:32:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 07:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:32:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:32:04 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-30 07:32:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:32:18 [DEBUG   ] Got command BAM from MCS: ref #675294
2018-11-30 07:32:18 [INFO    ] Finished processing BAM request
2018-11-30 07:32:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675294   8 58452 27138029 A  ERROR'
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:32:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:32:18 [DEBUG   ] spawn_process: at 2018-11-30 07:32:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:32:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:32:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:32:58 [DEBUG   ] Got command BAM from MCS: ref #675299
2018-11-30 07:32:58 [INFO    ] Finished processing BAM request
2018-11-30 07:32:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:32:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675299   8 58452 27178029 A  ERROR'
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:32:58 [DEBUG   ] spawn_process: at 2018-11-30 07:32:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:33:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:33:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:33:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:33:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:33:03 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-11-30 07:33:06 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 07:33:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:33:38 [DEBUG   ] Got command BAM from MCS: ref #675300
2018-11-30 07:33:38 [INFO    ] Finished processing BAM request
2018-11-30 07:33:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675300   8 58452 27218033 A  ERROR'
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:33:38 [DEBUG   ] spawn_process: at 2018-11-30 07:33:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:33:46 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-30 07:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:34:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:34:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:34:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:34:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:34:03 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-11-30 07:34:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:34:12 [DEBUG   ] Got command RPT from MCS: ref #675303
2018-11-30 07:34:12 [DEBUG   ] summary = ERROR
2018-11-30 07:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675303  13 58452 27252637 A  ERRORERROR'
2018-11-30 07:34:12 [DEBUG   ] Got command RPT from MCS: ref #675304
2018-11-30 07:34:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675304  77 58452 27252841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:34:13 [DEBUG   ] Got command RPT from MCS: ref #675305
2018-11-30 07:34:13 [DEBUG   ] summary = ERROR
2018-11-30 07:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675305  13 58452 27253045 A  ERRORERROR'
2018-11-30 07:34:13 [DEBUG   ] Got command RPT from MCS: ref #675307
2018-11-30 07:34:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675307  77 58452 27253237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:34:13 [DEBUG   ] Got command RPT from MCS: ref #675309
2018-11-30 07:34:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675309  12 58452 27253443 A  ERRORB›™š'
2018-11-30 07:34:18 [DEBUG   ] Got command BAM from MCS: ref #675313
2018-11-30 07:34:18 [INFO    ] Finished processing BAM request
2018-11-30 07:34:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675313   8 58452 27258029 A  ERROR'
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:34:18 [DEBUG   ] spawn_process: at 2018-11-30 07:34:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:34:26 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 07:34:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 07:34:58 [DEBUG   ] Got command BAM from MCS: ref #675314
2018-11-30 07:34:58 [INFO    ] Finished processing BAM request
2018-11-30 07:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675314   8 58452 27298029 A  ERROR'
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:34:58 [DEBUG   ] spawn_process: at 2018-11-30 07:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:35:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 07:35:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:35:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:35:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:35:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:35:03 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-30 07:35:06 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-30 07:35:25 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 07:35:38 [DEBUG   ] Got command BAM from MCS: ref #675319
2018-11-30 07:35:38 [INFO    ] Finished processing BAM request
2018-11-30 07:35:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675319   8 58452 27338029 A  ERROR'
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:35:38 [DEBUG   ] spawn_process: at 2018-11-30 07:35:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:35:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:35:49 [DEBUG   ] Got command RPT from MCS: ref #675320
2018-11-30 07:35:49 [DEBUG   ] summary = ERROR
2018-11-30 07:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675320  13 58452 27349949 A  ERRORERROR'
2018-11-30 07:35:49 [DEBUG   ] Got command RPT from MCS: ref #675321
2018-11-30 07:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675321  77 58452 27349950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:36:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:36:04 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-11-30 07:36:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:36:18 [DEBUG   ] Got command BAM from MCS: ref #675337
2018-11-30 07:36:18 [INFO    ] Finished processing BAM request
2018-11-30 07:36:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675337   8 58452 27378029 A  ERROR'
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:36:18 [DEBUG   ] spawn_process: at 2018-11-30 07:36:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:36:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:36:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:36:58 [DEBUG   ] Got command BAM from MCS: ref #675338
2018-11-30 07:36:58 [INFO    ] Finished processing BAM request
2018-11-30 07:36:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675338   8 58452 27418033 A  ERROR'
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:36:58 [DEBUG   ] spawn_process: at 2018-11-30 07:36:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:37:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:37:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:37:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:37:03 [WARNING ] (13, 1, 'bot')
2018-11-30 07:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:37:03 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-11-30 07:37:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:37:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:37:39 [DEBUG   ] Got command BAM from MCS: ref #675339
2018-11-30 07:37:39 [INFO    ] Finished processing BAM request
2018-11-30 07:37:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675339   8 58452 27459029 A  ERROR'
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:37:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:37:39 [DEBUG   ] spawn_process: at 2018-11-30 07:37:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:37:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:38:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:38:04 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-11-30 07:38:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:38:20 [DEBUG   ] Got command BAM from MCS: ref #675340
2018-11-30 07:38:20 [INFO    ] Finished processing BAM request
2018-11-30 07:38:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675340   8 58452 27500033 A  ERROR'
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:38:20 [DEBUG   ] spawn_process: at 2018-11-30 07:38:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:38:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:38:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:39:01 [DEBUG   ] Got command BAM from MCS: ref #675345
2018-11-30 07:39:01 [INFO    ] Finished processing BAM request
2018-11-30 07:39:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675345   8 58452 27541025 A  ERROR'
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:39:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:39:01 [DEBUG   ] spawn_process: at 2018-11-30 07:39:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:39:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:39:04 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-30 07:39:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:39:12 [DEBUG   ] Got command RPT from MCS: ref #675346
2018-11-30 07:39:12 [DEBUG   ] summary = ERROR
2018-11-30 07:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675346  13 58452 27552721 A  ERRORERROR'
2018-11-30 07:39:12 [DEBUG   ] Got command RPT from MCS: ref #675347
2018-11-30 07:39:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675347  77 58452 27552925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:39:13 [DEBUG   ] Got command RPT from MCS: ref #675348
2018-11-30 07:39:13 [DEBUG   ] summary = ERROR
2018-11-30 07:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675348  13 58452 27553129 A  ERRORERROR'
2018-11-30 07:39:13 [DEBUG   ] Got command RPT from MCS: ref #675349
2018-11-30 07:39:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675349  77 58452 27553321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:39:13 [DEBUG   ] Got command RPT from MCS: ref #675350
2018-11-30 07:39:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675350  12 58452 27553525 A  ERRORBš™š'
2018-11-30 07:39:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:39:42 [DEBUG   ] Got command BAM from MCS: ref #675351
2018-11-30 07:39:42 [INFO    ] Finished processing BAM request
2018-11-30 07:39:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675351   8 58452 27582033 A  ERROR'
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:39:42 [DEBUG   ] spawn_process: at 2018-11-30 07:39:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:39:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:40:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:40:04 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-30 07:40:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:40:23 [DEBUG   ] Got command BAM from MCS: ref #675352
2018-11-30 07:40:23 [INFO    ] Finished processing BAM request
2018-11-30 07:40:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:40:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675352   8 58452 27623029 A  ERROR'
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:40:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:40:23 [DEBUG   ] spawn_process: at 2018-11-30 07:40:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:40:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 07:40:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:40:49 [DEBUG   ] Got command RPT from MCS: ref #675353
2018-11-30 07:40:49 [DEBUG   ] summary = ERROR
2018-11-30 07:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675353  13 58452 27649949 A  ERRORERROR'
2018-11-30 07:40:49 [DEBUG   ] Got command RPT from MCS: ref #675354
2018-11-30 07:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675354  77 58452 27649950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:41:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 07:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:41:04 [DEBUG   ] Got command BAM from MCS: ref #675370
2018-11-30 07:41:04 [INFO    ] Finished processing BAM request
2018-11-30 07:41:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:41:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675370   8 58452 27664029 A  ERROR'
2018-11-30 07:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-30 07:41:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:41:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:41:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:41:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:41:04 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:41:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:41:04 [DEBUG   ] spawn_process: at 2018-11-30 07:41:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:41:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:41:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:41:46 [DEBUG   ] Got command BAM from MCS: ref #675375
2018-11-30 07:41:46 [INFO    ] Finished processing BAM request
2018-11-30 07:41:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675375   8 58452 27706033 A  ERROR'
2018-11-30 07:41:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:41:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:41:46 [DEBUG   ] spawn_process: at 2018-11-30 07:41:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 07:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 07:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:42:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:42:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:42:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:42:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:42:04 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-30 07:42:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:42:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:42:28 [DEBUG   ] Got command BAM from MCS: ref #675376
2018-11-30 07:42:28 [INFO    ] Finished processing BAM request
2018-11-30 07:42:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675376   8 58452 27748025 A  ERROR'
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:42:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:42:28 [DEBUG   ] spawn_process: at 2018-11-30 07:42:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:42:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:43:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:43:05 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-11-30 07:43:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:43:10 [DEBUG   ] Got command BAM from MCS: ref #675377
2018-11-30 07:43:10 [INFO    ] Finished processing BAM request
2018-11-30 07:43:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675377   8 58452 27790029 A  ERROR'
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-30 07:43:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-30 07:43:10 [DEBUG   ] spawn_process: at 2018-11-30 07:43:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-30 07:43:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:43:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:43:52 [DEBUG   ] Got command BAM from MCS: ref #675380
2018-11-30 07:43:52 [INFO    ] Finished processing BAM request
2018-11-30 07:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675380   8 58452 27832029 A  ERROR'
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:43:52 [DEBUG   ] spawn_process: at 2018-11-30 07:43:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:44:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:44:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:44:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:44:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:44:04 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-30 07:44:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:44:12 [DEBUG   ] Got command RPT from MCS: ref #675381
2018-11-30 07:44:12 [DEBUG   ] summary = ERROR
2018-11-30 07:44:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675381  13 58452 27852805 A  ERRORERROR'
2018-11-30 07:44:13 [DEBUG   ] Got command RPT from MCS: ref #675382
2018-11-30 07:44:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675382  77 58452 27853009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:44:13 [DEBUG   ] Got command RPT from MCS: ref #675383
2018-11-30 07:44:13 [DEBUG   ] summary = ERROR
2018-11-30 07:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675383  13 58452 27853213 A  ERRORERROR'
2018-11-30 07:44:13 [DEBUG   ] Got command RPT from MCS: ref #675385
2018-11-30 07:44:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675385  77 58452 27853405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:44:13 [DEBUG   ] Got command RPT from MCS: ref #675387
2018-11-30 07:44:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675387  12 58452 27853609 A  ERRORBœ™š'
2018-11-30 07:44:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:44:34 [DEBUG   ] Got command BAM from MCS: ref #675395
2018-11-30 07:44:34 [INFO    ] Finished processing BAM request
2018-11-30 07:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675395   8 58452 27874033 A  ERROR'
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:44:34 [DEBUG   ] spawn_process: at 2018-11-30 07:44:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:44:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:45:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:45:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:45:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:45:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:45:04 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-30 07:45:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:45:16 [DEBUG   ] Got command BAM from MCS: ref #675396
2018-11-30 07:45:16 [INFO    ] Finished processing BAM request
2018-11-30 07:45:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675396   8 58452 27916033 A  ERROR'
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:45:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:45:16 [DEBUG   ] spawn_process: at 2018-11-30 07:45:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:45:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:45:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:45:49 [DEBUG   ] Got command RPT from MCS: ref #675397
2018-11-30 07:45:49 [DEBUG   ] summary = ERROR
2018-11-30 07:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675397  13 58452 27949949 A  ERRORERROR'
2018-11-30 07:45:49 [DEBUG   ] Got command RPT from MCS: ref #675398
2018-11-30 07:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675398  77 58452 27949950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:45:59 [DEBUG   ] Got command BAM from MCS: ref #675414
2018-11-30 07:45:59 [INFO    ] Finished processing BAM request
2018-11-30 07:45:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675414   8 58452 27959025 A  ERROR'
2018-11-30 07:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:45:59 [DEBUG   ] spawn_process: at 2018-11-30 07:45:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:46:00 [DEBUG   ] spawn_process: at 2018-11-30 07:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:46:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:46:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:46:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:46:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:46:04 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-11-30 07:46:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:46:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:46:42 [DEBUG   ] Got command BAM from MCS: ref #675415
2018-11-30 07:46:42 [INFO    ] Finished processing BAM request
2018-11-30 07:46:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675415   8 58452 28002029 A  ERROR'
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:46:42 [DEBUG   ] spawn_process: at 2018-11-30 07:46:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:46:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 07:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 07:47:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:47:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:47:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:47:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:47:04 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-11-30 07:47:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:47:25 [DEBUG   ] Got command BAM from MCS: ref #675416
2018-11-30 07:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675416   8 58452 28045025 A  ERROR'
2018-11-30 07:47:25 [INFO    ] Finished processing BAM request
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-30 07:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-30 07:47:25 [DEBUG   ] spawn_process: at 2018-11-30 07:47:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-30 07:47:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 07:47:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 07:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:48:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:48:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:48:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:48:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:48:04 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-30 07:48:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 07:48:08 [DEBUG   ] Got command BAM from MCS: ref #675421
2018-11-30 07:48:08 [INFO    ] Finished processing BAM request
2018-11-30 07:48:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675421   8 58452 28088029 A  ERROR'
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-30 07:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-30 07:48:08 [DEBUG   ] spawn_process: at 2018-11-30 07:48:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-30 07:48:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:48:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:48:51 [DEBUG   ] Got command BAM from MCS: ref #675422
2018-11-30 07:48:51 [INFO    ] Finished processing BAM request
2018-11-30 07:48:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675422   8 58452 28131029 A  ERROR'
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:48:51 [DEBUG   ] spawn_process: at 2018-11-30 07:48:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 07:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:49:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:49:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:49:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:49:04 [WARNING ] (13, 1, 'bot')
2018-11-30 07:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:49:04 [DEBUG   ] Finished updating board flags in 0.931 seconds
2018-11-30 07:49:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:49:12 [DEBUG   ] Got command RPT from MCS: ref #675423
2018-11-30 07:49:12 [DEBUG   ] summary = ERROR
2018-11-30 07:49:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675423  13 58452 28152893 A  ERRORERROR'
2018-11-30 07:49:13 [DEBUG   ] Got command RPT from MCS: ref #675424
2018-11-30 07:49:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675424  77 58452 28153097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:49:13 [DEBUG   ] Got command RPT from MCS: ref #675425
2018-11-30 07:49:13 [DEBUG   ] summary = ERROR
2018-11-30 07:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675425  13 58452 28153301 A  ERRORERROR'
2018-11-30 07:49:13 [DEBUG   ] Got command RPT from MCS: ref #675426
2018-11-30 07:49:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675426  77 58452 28153493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:49:13 [DEBUG   ] Got command RPT from MCS: ref #675427
2018-11-30 07:49:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675427  12 58452 28153697 A  ERRORB�ff'
2018-11-30 07:49:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:49:35 [DEBUG   ] Got command BAM from MCS: ref #675428
2018-11-30 07:49:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-30 07:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675428   8 58452 28175025 A  ERROR'
2018-11-30 07:49:35 [INFO    ] Finished processing BAM request
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-30 07:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-30 07:49:35 [DEBUG   ] spawn_process: at 2018-11-30 07:49:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-30 07:49:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:50:00 [DEBUG   ] Got command STP from MCS: ref #675429
2018-11-30 07:50:00 [INFO    ] Finished processing BAM request
2018-11-30 07:50:00 [INFO    ] Shutdown the adder chain on beam #4
2018-11-30 07:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   675429   8 58452 28200033 A  ERROR'
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-30 07:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-30 07:50:00 [DEBUG   ] spawn_process: at 2018-11-30 07:50:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-30 07:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:50:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:50:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:50:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:50:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:50:05 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-30 07:50:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:50:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:50:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:50:49 [DEBUG   ] Got command RPT from MCS: ref #675434
2018-11-30 07:50:49 [DEBUG   ] summary = ERROR
2018-11-30 07:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675434  13 58452 28249949 A  ERRORERROR'
2018-11-30 07:50:49 [DEBUG   ] Got command RPT from MCS: ref #675435
2018-11-30 07:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675435  77 58452 28249950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:51:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:51:05 [DEBUG   ] Finished updating board flags in 1.261 seconds
2018-11-30 07:51:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:51:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 07:51:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:52:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:52:05 [DEBUG   ] Finished updating board flags in 1.137 seconds
2018-11-30 07:52:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:52:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:52:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 07:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:53:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:53:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:53:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:53:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:53:05 [DEBUG   ] Finished updating board flags in 1.058 seconds
2018-11-30 07:53:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 07:53:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:53:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 07:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:54:06 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-30 07:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:54:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:54:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:54:06 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-30 07:54:12 [DEBUG   ] Got command RPT from MCS: ref #675457
2018-11-30 07:54:12 [DEBUG   ] summary = ERROR
2018-11-30 07:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675457  13 58452 28452977 A  ERRORERROR'
2018-11-30 07:54:13 [DEBUG   ] Got command RPT from MCS: ref #675458
2018-11-30 07:54:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675458  77 58452 28453181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:54:13 [DEBUG   ] Got command RPT from MCS: ref #675459
2018-11-30 07:54:13 [DEBUG   ] summary = ERROR
2018-11-30 07:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675459  13 58452 28453385 A  ERRORERROR'
2018-11-30 07:54:13 [DEBUG   ] Got command RPT from MCS: ref #675461
2018-11-30 07:54:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675461  77 58452 28453577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:54:13 [DEBUG   ] Got command RPT from MCS: ref #675462
2018-11-30 07:54:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675462  12 58452 28453781 A  ERRORB—™š'
2018-11-30 07:54:26 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-30 07:54:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 07:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:55:06 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2018-11-30 07:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:55:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:55:06 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-11-30 07:55:26 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-30 07:55:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:55:49 [DEBUG   ] Got command RPT from MCS: ref #675467
2018-11-30 07:55:49 [DEBUG   ] summary = ERROR
2018-11-30 07:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675467  13 58452 28549949 A  ERRORERROR'
2018-11-30 07:55:49 [DEBUG   ] Got command RPT from MCS: ref #675468
2018-11-30 07:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675468  77 58452 28549950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:56:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:56:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:56:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:56:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:56:05 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-30 07:56:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:56:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:56:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:57:06 [WARNING ] (13, 1, 'bot')
2018-11-30 07:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:57:06 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-11-30 07:57:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:57:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:57:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 07:58:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:58:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:58:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:58:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:58:05 [DEBUG   ] Finished updating board flags in 1.168 seconds
2018-11-30 07:58:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:58:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:58:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 07:59:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:59:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:59:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:59:05 [WARNING ] (13, 1, 'bot')
2018-11-30 07:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 07:59:05 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-30 07:59:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 07:59:13 [DEBUG   ] Got command RPT from MCS: ref #675488
2018-11-30 07:59:13 [DEBUG   ] summary = ERROR
2018-11-30 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675488  13 58452 28753061 A  ERRORERROR'
2018-11-30 07:59:13 [DEBUG   ] Got command RPT from MCS: ref #675489
2018-11-30 07:59:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675489  77 58452 28753265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:59:13 [DEBUG   ] Got command RPT from MCS: ref #675490
2018-11-30 07:59:13 [DEBUG   ] summary = ERROR
2018-11-30 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675490  13 58452 28753469 A  ERRORERROR'
2018-11-30 07:59:13 [DEBUG   ] Got command RPT from MCS: ref #675491
2018-11-30 07:59:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675491  77 58452 28753661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 07:59:13 [DEBUG   ] Got command RPT from MCS: ref #675492
2018-11-30 07:59:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675492  12 58452 28753865 A  ERRORB–™š'
2018-11-30 07:59:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 07:59:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:00:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:00:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:00:06 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-11-30 08:00:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 08:00:27 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-30 08:00:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:00:49 [DEBUG   ] Got command RPT from MCS: ref #675497
2018-11-30 08:00:49 [DEBUG   ] summary = ERROR
2018-11-30 08:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675497  13 58452 28849949 A  ERRORERROR'
2018-11-30 08:00:49 [DEBUG   ] Got command RPT from MCS: ref #675498
2018-11-30 08:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675498  77 58452 28849950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 08:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:01:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:01:06 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-11-30 08:01:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:01:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:01:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:02:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:02:06 [DEBUG   ] Finished updating board flags in 1.294 seconds
2018-11-30 08:02:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 08:02:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:02:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 08:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:03:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:03:06 [DEBUG   ] Finished updating board flags in 1.102 seconds
2018-11-30 08:03:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 08:03:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 08:03:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 08:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:04:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:04:06 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-30 08:04:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 08:04:13 [DEBUG   ] Got command RPT from MCS: ref #675520
2018-11-30 08:04:13 [DEBUG   ] summary = ERROR
2018-11-30 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675520  13 58452 29053149 A  ERRORERROR'
2018-11-30 08:04:13 [DEBUG   ] Got command RPT from MCS: ref #675521
2018-11-30 08:04:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675521  77 58452 29053353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:04:13 [DEBUG   ] Got command RPT from MCS: ref #675522
2018-11-30 08:04:13 [DEBUG   ] summary = ERROR
2018-11-30 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675522  13 58452 29053557 A  ERRORERROR'
2018-11-30 08:04:13 [DEBUG   ] Got command RPT from MCS: ref #675524
2018-11-30 08:04:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675524  77 58452 29053749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:04:13 [DEBUG   ] Got command RPT from MCS: ref #675525
2018-11-30 08:04:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675525  12 58452 29053953 A  ERRORB—™š'
2018-11-30 08:04:27 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 08:04:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:05:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:05:06 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-30 08:05:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:05:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:05:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:05:49 [DEBUG   ] Got command RPT from MCS: ref #675534
2018-11-30 08:05:49 [DEBUG   ] summary = ERROR
2018-11-30 08:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675534  13 58452 29149949 A  ERRORERROR'
2018-11-30 08:05:49 [DEBUG   ] Got command RPT from MCS: ref #675535
2018-11-30 08:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675535  77 58452 29149950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:06:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:06:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:06:06 [DEBUG   ] Finished updating board flags in 1.295 seconds
2018-11-30 08:06:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:06:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:06:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:07:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 08:07:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:07:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:07:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:07:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:07:06 [DEBUG   ] Finished updating board flags in 1.152 seconds
2018-11-30 08:07:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:07:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:07:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:08:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:08:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:08:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:08:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:08:06 [WARNING ] (13, 1, 'bot')
2018-11-30 08:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:08:06 [DEBUG   ] Finished updating board flags in 1.042 seconds
2018-11-30 08:08:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:08:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 08:08:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:09:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:09:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:09:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:09:07 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-11-30 08:09:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:09:13 [DEBUG   ] Got command RPT from MCS: ref #675555
2018-11-30 08:09:13 [DEBUG   ] summary = ERROR
2018-11-30 08:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675555  13 58452 29353229 A  ERRORERROR'
2018-11-30 08:09:13 [DEBUG   ] Got command RPT from MCS: ref #675556
2018-11-30 08:09:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675556  77 58452 29353433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:09:13 [DEBUG   ] Got command RPT from MCS: ref #675557
2018-11-30 08:09:13 [DEBUG   ] summary = ERROR
2018-11-30 08:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675557  13 58452 29353637 A  ERRORERROR'
2018-11-30 08:09:13 [DEBUG   ] Got command RPT from MCS: ref #675558
2018-11-30 08:09:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675558  77 58452 29353841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:09:14 [DEBUG   ] Got command RPT from MCS: ref #675559
2018-11-30 08:09:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675559  12 58452 29354040 A  ERRORB—™š'
2018-11-30 08:09:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 08:09:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 08:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:10:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:10:07 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-30 08:10:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 08:10:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 08:10:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:10:49 [DEBUG   ] Got command RPT from MCS: ref #675560
2018-11-30 08:10:49 [DEBUG   ] summary = ERROR
2018-11-30 08:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675560  13 58452 29449957 A  ERRORERROR'
2018-11-30 08:10:49 [DEBUG   ] Got command RPT from MCS: ref #675561
2018-11-30 08:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675561  77 58452 29449958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:11:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:11:07 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-11-30 08:11:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:11:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:11:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:12:00 [DEBUG   ] Got command TBN from MCS: ref #675581
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-30 08:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   675581   8 58452 29520313 A  ERROR'
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543565521']
2018-11-30 08:12:00 [DEBUG   ] spawn_process: at 2018-11-30 08:12:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543565521']
2018-11-30 08:12:00 [INFO    ] Finished spawning TBN in 0.050 s
2018-11-30 08:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:12:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:12:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:12:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:12:07 [WARNING ] (13, 1, 'bot')
2018-11-30 08:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:12:07 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-11-30 08:12:08 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2018-11-30 08:12:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:12:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:13:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:13:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:13:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:13:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:13:08 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-11-30 08:13:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:13:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:13:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 08:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:14:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:14:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:14:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:14:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:14:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:14:08 [DEBUG   ] Finished updating board flags in 2.096 seconds
2018-11-30 08:14:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 08:14:13 [DEBUG   ] Got command RPT from MCS: ref #675584
2018-11-30 08:14:13 [DEBUG   ] summary = ERROR
2018-11-30 08:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675584  13 58452 29653321 A  ERRORERROR'
2018-11-30 08:14:13 [DEBUG   ] Got command RPT from MCS: ref #675585
2018-11-30 08:14:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675585  77 58452 29653513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:14:13 [DEBUG   ] Got command RPT from MCS: ref #675586
2018-11-30 08:14:13 [DEBUG   ] summary = ERROR
2018-11-30 08:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675586  13 58452 29653717 A  ERRORERROR'
2018-11-30 08:14:13 [DEBUG   ] Got command RPT from MCS: ref #675588
2018-11-30 08:14:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675588  77 58452 29653921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:14:14 [DEBUG   ] Got command RPT from MCS: ref #675589
2018-11-30 08:14:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675589  12 58452 29654125 A  ERRORB•™š'
2018-11-30 08:14:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 08:14:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 08:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:15:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:15:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:15:08 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-11-30 08:15:09 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-30 08:15:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:15:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 08:15:49 [DEBUG   ] Got command RPT from MCS: ref #675598
2018-11-30 08:15:49 [DEBUG   ] summary = ERROR
2018-11-30 08:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675598  13 58452 29749957 A  ERRORERROR'
2018-11-30 08:15:49 [DEBUG   ] Got command RPT from MCS: ref #675599
2018-11-30 08:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675599  77 58452 29749958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:16:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:16:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:16:08 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-11-30 08:16:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 08:16:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:16:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 08:17:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:17:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:17:08 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-30 08:17:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:17:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 08:17:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 08:18:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:18:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:18:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:18:08 [DEBUG   ] Finished updating board flags in 1.733 seconds
2018-11-30 08:18:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-30 08:18:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 08:18:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 08:19:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 08:19:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:19:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:19:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:19:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:19:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:19:08 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-30 08:19:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 08:19:13 [DEBUG   ] Got command RPT from MCS: ref #675619
2018-11-30 08:19:13 [DEBUG   ] summary = ERROR
2018-11-30 08:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675619  13 58452 29953405 A  ERRORERROR'
2018-11-30 08:19:13 [DEBUG   ] Got command RPT from MCS: ref #675620
2018-11-30 08:19:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675620  77 58452 29953609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:19:13 [DEBUG   ] Got command RPT from MCS: ref #675621
2018-11-30 08:19:13 [DEBUG   ] summary = ERROR
2018-11-30 08:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675621  13 58452 29953813 A  ERRORERROR'
2018-11-30 08:19:14 [DEBUG   ] Got command RPT from MCS: ref #675622
2018-11-30 08:19:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675622  77 58452 29954005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:19:14 [DEBUG   ] Got command RPT from MCS: ref #675623
2018-11-30 08:19:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675623  12 58452 29954209 A  ERRORB—™š'
2018-11-30 08:19:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 08:19:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:20:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:20:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:20:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:20:08 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-30 08:20:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 08:20:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 08:20:49 [DEBUG   ] Got command RPT from MCS: ref #675628
2018-11-30 08:20:49 [DEBUG   ] summary = ERROR
2018-11-30 08:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675628  13 58452 30049961 A  ERRORERROR'
2018-11-30 08:20:49 [DEBUG   ] Got command RPT from MCS: ref #675629
2018-11-30 08:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675629  77 58452 30049962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:20:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 08:21:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:21:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:21:08 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-11-30 08:21:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:21:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:21:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 08:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:22:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:22:08 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-11-30 08:22:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:22:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 08:22:51 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-30 08:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:23:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:23:08 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-30 08:23:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 08:23:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 08:23:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 08:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:24:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:24:08 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-30 08:24:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 08:24:13 [DEBUG   ] Got command RPT from MCS: ref #675651
2018-11-30 08:24:13 [DEBUG   ] summary = ERROR
2018-11-30 08:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675651  13 58452 30253489 A  ERRORERROR'
2018-11-30 08:24:13 [DEBUG   ] Got command RPT from MCS: ref #675652
2018-11-30 08:24:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675652  77 58452 30253693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:24:13 [DEBUG   ] Got command RPT from MCS: ref #675653
2018-11-30 08:24:13 [DEBUG   ] summary = ERROR
2018-11-30 08:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675653  13 58452 30253897 A  ERRORERROR'
2018-11-30 08:24:14 [DEBUG   ] Got command RPT from MCS: ref #675655
2018-11-30 08:24:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675655  77 58452 30254089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:24:14 [DEBUG   ] Got command RPT from MCS: ref #675656
2018-11-30 08:24:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675656  12 58452 30254293 A  ERRORB—™š'
2018-11-30 08:24:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 08:24:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:25:08 [WARNING ] (13, 1, 'bot')
2018-11-30 08:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:25:08 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-11-30 08:25:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 08:25:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 08:25:49 [DEBUG   ] Got command RPT from MCS: ref #675661
2018-11-30 08:25:49 [DEBUG   ] summary = ERROR
2018-11-30 08:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675661  13 58452 30349961 A  ERRORERROR'
2018-11-30 08:25:49 [DEBUG   ] Got command RPT from MCS: ref #675662
2018-11-30 08:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675662  77 58452 30349962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:25:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 08:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:26:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:26:09 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-11-30 08:26:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:26:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:26:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:27:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:27:09 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-11-30 08:27:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:27:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:27:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:28:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:28:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:28:09 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-11-30 08:28:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:28:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 08:28:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:29:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:29:09 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-11-30 08:29:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:29:13 [DEBUG   ] Got command RPT from MCS: ref #675682
2018-11-30 08:29:13 [DEBUG   ] summary = ERROR
2018-11-30 08:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675682  13 58452 30553581 A  ERRORERROR'
2018-11-30 08:29:13 [DEBUG   ] Got command RPT from MCS: ref #675683
2018-11-30 08:29:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675683  77 58452 30553785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:29:13 [DEBUG   ] Got command RPT from MCS: ref #675684
2018-11-30 08:29:13 [DEBUG   ] summary = ERROR
2018-11-30 08:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675684  13 58452 30553977 A  ERRORERROR'
2018-11-30 08:29:14 [DEBUG   ] Got command RPT from MCS: ref #675685
2018-11-30 08:29:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675685  77 58452 30554181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:29:14 [DEBUG   ] Got command RPT from MCS: ref #675686
2018-11-30 08:29:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675686  12 58452 30554385 A  ERRORB–™š'
2018-11-30 08:29:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:29:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:30:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:30:09 [DEBUG   ] Finished updating board flags in 2.115 seconds
2018-11-30 08:30:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:30:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:30:49 [DEBUG   ] Got command RPT from MCS: ref #675691
2018-11-30 08:30:49 [DEBUG   ] summary = ERROR
2018-11-30 08:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675691  13 58452 30649961 A  ERRORERROR'
2018-11-30 08:30:49 [DEBUG   ] Got command RPT from MCS: ref #675692
2018-11-30 08:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675692  77 58452 30649962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:30:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:31:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:31:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:31:09 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-11-30 08:31:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 08:31:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 08:31:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 08:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:32:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:32:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:32:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:32:09 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-30 08:32:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 08:32:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 08:32:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 08:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:33:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:33:09 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-30 08:33:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 08:33:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 08:33:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 08:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 08:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:34:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:34:09 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-30 08:34:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:34:13 [DEBUG   ] Got command RPT from MCS: ref #675714
2018-11-30 08:34:13 [DEBUG   ] summary = ERROR
2018-11-30 08:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675714  13 58452 30853665 A  ERRORERROR'
2018-11-30 08:34:13 [DEBUG   ] Got command RPT from MCS: ref #675715
2018-11-30 08:34:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675715  77 58452 30853869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:34:14 [DEBUG   ] Got command RPT from MCS: ref #675716
2018-11-30 08:34:14 [DEBUG   ] summary = ERROR
2018-11-30 08:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675716  13 58452 30854061 A  ERRORERROR'
2018-11-30 08:34:14 [DEBUG   ] Got command RPT from MCS: ref #675718
2018-11-30 08:34:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675718  77 58452 30854265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:34:14 [DEBUG   ] Got command RPT from MCS: ref #675719
2018-11-30 08:34:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675719  12 58452 30854469 A  ERRORB—™š'
2018-11-30 08:34:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 08:34:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 08:35:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 08:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:35:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:35:09 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-30 08:35:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:35:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 08:35:49 [DEBUG   ] Got command RPT from MCS: ref #675728
2018-11-30 08:35:49 [DEBUG   ] summary = ERROR
2018-11-30 08:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675728  13 58452 30949961 A  ERRORERROR'
2018-11-30 08:35:49 [DEBUG   ] Got command RPT from MCS: ref #675729
2018-11-30 08:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675729  77 58452 30949962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:35:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 08:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:36:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:36:09 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-11-30 08:36:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 08:36:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:36:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 08:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:37:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:37:09 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-30 08:37:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 08:37:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:37:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:38:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:38:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:38:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:38:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:38:09 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-30 08:38:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 08:38:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-30 08:38:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 08:39:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:39:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:39:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:39:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:39:09 [WARNING ] (13, 1, 'bot')
2018-11-30 08:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:39:09 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-30 08:39:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 08:39:13 [DEBUG   ] Got command RPT from MCS: ref #675749
2018-11-30 08:39:13 [DEBUG   ] summary = ERROR
2018-11-30 08:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675749  13 58452 31153749 A  ERRORERROR'
2018-11-30 08:39:13 [DEBUG   ] Got command RPT from MCS: ref #675750
2018-11-30 08:39:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675750  77 58452 31153953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:39:14 [DEBUG   ] Got command RPT from MCS: ref #675751
2018-11-30 08:39:14 [DEBUG   ] summary = ERROR
2018-11-30 08:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675751  13 58452 31154157 A  ERRORERROR'
2018-11-30 08:39:14 [DEBUG   ] Got command RPT from MCS: ref #675752
2018-11-30 08:39:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675752  77 58452 31154361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:39:14 [DEBUG   ] Got command RPT from MCS: ref #675753
2018-11-30 08:39:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675753  12 58452 31154553 A  ERRORB˜™š'
2018-11-30 08:39:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 08:39:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 08:40:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:40:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:40:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:40:10 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-11-30 08:40:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:40:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:40:49 [DEBUG   ] Got command RPT from MCS: ref #675754
2018-11-30 08:40:49 [DEBUG   ] summary = ERROR
2018-11-30 08:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675754  13 58452 31249961 A  ERRORERROR'
2018-11-30 08:40:49 [DEBUG   ] Got command RPT from MCS: ref #675755
2018-11-30 08:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675755  77 58452 31249962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:40:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:41:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:41:10 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-11-30 08:41:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 08:41:34 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-30 08:41:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 08:42:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:42:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:42:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:42:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:42:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:42:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:42:10 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 08:42:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 08:42:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-30 08:42:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 08:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:43:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:43:10 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-30 08:43:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 08:43:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:43:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:44:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:44:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:44:10 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-30 08:44:13 [DEBUG   ] Got command RPT from MCS: ref #675777
2018-11-30 08:44:13 [DEBUG   ] summary = ERROR
2018-11-30 08:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675777  13 58452 31453837 A  ERRORERROR'
2018-11-30 08:44:14 [DEBUG   ] Got command RPT from MCS: ref #675778
2018-11-30 08:44:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675778  77 58452 31454041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:44:14 [DEBUG   ] Got command RPT from MCS: ref #675779
2018-11-30 08:44:14 [DEBUG   ] summary = ERROR
2018-11-30 08:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675779  13 58452 31454233 A  ERRORERROR'
2018-11-30 08:44:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 08:44:14 [DEBUG   ] Got command RPT from MCS: ref #675781
2018-11-30 08:44:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675781  77 58452 31454437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:44:14 [DEBUG   ] Got command RPT from MCS: ref #675782
2018-11-30 08:44:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675782  12 58452 31454641 A  ERRORB–™š'
2018-11-30 08:44:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 08:44:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:45:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:45:10 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-30 08:45:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:45:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 08:45:49 [DEBUG   ] Got command RPT from MCS: ref #675791
2018-11-30 08:45:49 [DEBUG   ] summary = ERROR
2018-11-30 08:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675791  13 58452 31549961 A  ERRORERROR'
2018-11-30 08:45:49 [DEBUG   ] Got command RPT from MCS: ref #675792
2018-11-30 08:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675792  77 58452 31549962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:45:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:46:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:46:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:46:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:46:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:46:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:46:10 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-11-30 08:46:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:46:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:46:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 08:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:47:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:47:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:47:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:47:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:47:10 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-30 08:47:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 08:47:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 08:47:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 08:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:48:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:48:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:48:10 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-11-30 08:48:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 08:48:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 08:48:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 08:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 08:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:49:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:49:10 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-30 08:49:13 [DEBUG   ] Got command RPT from MCS: ref #675812
2018-11-30 08:49:13 [DEBUG   ] summary = ERROR
2018-11-30 08:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675812  13 58452 31753925 A  ERRORERROR'
2018-11-30 08:49:14 [DEBUG   ] Got command RPT from MCS: ref #675813
2018-11-30 08:49:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675813  77 58452 31754130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:49:14 [DEBUG   ] Got command RPT from MCS: ref #675814
2018-11-30 08:49:14 [DEBUG   ] summary = ERROR
2018-11-30 08:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675814  13 58452 31754321 A  ERRORERROR'
2018-11-30 08:49:14 [DEBUG   ] Got command RPT from MCS: ref #675815
2018-11-30 08:49:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675815  77 58452 31754525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:49:14 [DEBUG   ] Got command RPT from MCS: ref #675816
2018-11-30 08:49:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675816  12 58452 31754729 A  ERRORB—™š'
2018-11-30 08:49:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 08:49:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 08:49:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 08:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:50:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:50:10 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-11-30 08:50:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 08:50:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 08:50:49 [DEBUG   ] Got command RPT from MCS: ref #675821
2018-11-30 08:50:49 [DEBUG   ] summary = ERROR
2018-11-30 08:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675821  13 58452 31849969 A  ERRORERROR'
2018-11-30 08:50:49 [DEBUG   ] Got command RPT from MCS: ref #675822
2018-11-30 08:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675822  77 58452 31849970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:50:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 08:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 08:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:51:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:51:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:51:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:51:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:51:10 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-11-30 08:51:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 08:51:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:51:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 08:52:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:52:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:52:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:52:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:52:10 [WARNING ] (13, 1, 'bot')
2018-11-30 08:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:52:10 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-30 08:52:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 08:52:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 08:52:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 08:53:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:53:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:53:11 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-11-30 08:53:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 08:53:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:53:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 08:54:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:54:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:54:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:54:11 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-11-30 08:54:14 [DEBUG   ] Got command RPT from MCS: ref #675844
2018-11-30 08:54:14 [DEBUG   ] summary = ERROR
2018-11-30 08:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675844  13 58452 32054005 A  ERRORERROR'
2018-11-30 08:54:14 [DEBUG   ] Got command RPT from MCS: ref #675845
2018-11-30 08:54:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675845  77 58452 32054209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:54:14 [DEBUG   ] Got command RPT from MCS: ref #675846
2018-11-30 08:54:14 [DEBUG   ] summary = ERROR
2018-11-30 08:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675846  13 58452 32054413 A  ERRORERROR'
2018-11-30 08:54:14 [DEBUG   ] Got command RPT from MCS: ref #675848
2018-11-30 08:54:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675848  77 58452 32054605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:54:14 [DEBUG   ] Got command RPT from MCS: ref #675850
2018-11-30 08:54:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675850  12 58452 32054809 A  ERRORB˜™š'
2018-11-30 08:54:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 08:54:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 08:54:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 08:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 08:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:55:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:55:11 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-30 08:55:16 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2018-11-30 08:55:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 08:55:49 [DEBUG   ] Got command RPT from MCS: ref #675854
2018-11-30 08:55:49 [DEBUG   ] summary = ERROR
2018-11-30 08:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675854  13 58452 32149965 A  ERRORERROR'
2018-11-30 08:55:49 [DEBUG   ] Got command RPT from MCS: ref #675855
2018-11-30 08:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675855  77 58452 32149966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:55:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 08:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:56:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:56:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:56:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:56:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:56:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:56:11 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-30 08:56:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 08:56:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 08:56:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 08:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:57:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:57:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:57:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:57:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:57:11 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-30 08:57:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 08:57:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 08:57:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 08:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:58:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:58:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-30 08:58:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 08:58:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:58:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 08:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 08:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:59:11 [WARNING ] (13, 1, 'bot')
2018-11-30 08:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 08:59:11 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-30 08:59:14 [DEBUG   ] Got command RPT from MCS: ref #675875
2018-11-30 08:59:14 [DEBUG   ] summary = ERROR
2018-11-30 08:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675875  13 58452 32354085 A  ERRORERROR'
2018-11-30 08:59:14 [DEBUG   ] Got command RPT from MCS: ref #675876
2018-11-30 08:59:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675876  77 58452 32354289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:59:14 [DEBUG   ] Got command RPT from MCS: ref #675877
2018-11-30 08:59:14 [DEBUG   ] summary = ERROR
2018-11-30 08:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675877  13 58452 32354493 A  ERRORERROR'
2018-11-30 08:59:14 [DEBUG   ] Got command RPT from MCS: ref #675878
2018-11-30 08:59:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 08:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675878  77 58452 32354697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 08:59:14 [DEBUG   ] Got command RPT from MCS: ref #675879
2018-11-30 08:59:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 08:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675879  12 58452 32354889 A  ERRORB—™š'
2018-11-30 08:59:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 08:59:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 08:59:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:00:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:00:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:00:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:00:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:00:11 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-30 09:00:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 09:00:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 09:00:49 [DEBUG   ] Got command RPT from MCS: ref #675884
2018-11-30 09:00:49 [DEBUG   ] summary = ERROR
2018-11-30 09:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675884  13 58452 32449969 A  ERRORERROR'
2018-11-30 09:00:49 [DEBUG   ] Got command RPT from MCS: ref #675885
2018-11-30 09:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675885  77 58452 32449970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:00:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-30 09:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:01:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:01:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:01:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:01:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:01:11 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-30 09:01:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 09:01:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:01:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:02:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:02:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:02:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:02:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:02:11 [WARNING ] (13, 1, 'bot')
2018-11-30 09:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:02:11 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-30 09:02:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 09:02:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:02:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 09:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:03:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:03:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:03:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:03:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:03:12 [DEBUG   ] Finished updating board flags in 2.118 seconds
2018-11-30 09:03:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:03:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:03:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 09:04:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:04:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:04:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:04:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:04:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:04:12 [DEBUG   ] Finished updating board flags in 1.925 seconds
2018-11-30 09:04:14 [DEBUG   ] Got command RPT from MCS: ref #675907
2018-11-30 09:04:14 [DEBUG   ] summary = ERROR
2018-11-30 09:04:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675907  13 58452 32654173 A  ERRORERROR'
2018-11-30 09:04:14 [DEBUG   ] Got command RPT from MCS: ref #675908
2018-11-30 09:04:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:04:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675908  77 58452 32654377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:04:14 [DEBUG   ] Got command RPT from MCS: ref #675909
2018-11-30 09:04:14 [DEBUG   ] summary = ERROR
2018-11-30 09:04:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675909  13 58452 32654581 A  ERRORERROR'
2018-11-30 09:04:14 [DEBUG   ] Got command RPT from MCS: ref #675911
2018-11-30 09:04:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:04:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675911  77 58452 32654785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:04:14 [DEBUG   ] Got command RPT from MCS: ref #675913
2018-11-30 09:04:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:04:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675913  12 58452 32654977 A  ERRORB•™š'
2018-11-30 09:04:18 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-30 09:04:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:04:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:05:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:05:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:05:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:05:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:05:12 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-30 09:05:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-30 09:05:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 09:05:49 [DEBUG   ] Got command RPT from MCS: ref #675921
2018-11-30 09:05:49 [DEBUG   ] summary = ERROR
2018-11-30 09:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675921  13 58452 32749965 A  ERRORERROR'
2018-11-30 09:05:49 [DEBUG   ] Got command RPT from MCS: ref #675922
2018-11-30 09:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675922  77 58452 32749966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:05:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 09:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:06:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:06:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:06:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:06:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:06:12 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-30 09:06:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 09:06:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 09:06:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 09:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:07:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:07:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:07:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:07:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:07:12 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-11-30 09:07:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 09:07:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:07:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 09:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:08:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:08:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:08:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:08:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:08:12 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-30 09:08:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:08:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:08:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:09:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:09:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:09:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:09:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:09:12 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-30 09:09:14 [DEBUG   ] Got command RPT from MCS: ref #675942
2018-11-30 09:09:14 [DEBUG   ] summary = ERROR
2018-11-30 09:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675942  13 58452 32954257 A  ERRORERROR'
2018-11-30 09:09:14 [DEBUG   ] Got command RPT from MCS: ref #675943
2018-11-30 09:09:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675943  77 58452 32954461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:09:14 [DEBUG   ] Got command RPT from MCS: ref #675944
2018-11-30 09:09:14 [DEBUG   ] summary = ERROR
2018-11-30 09:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675944  13 58452 32954665 A  ERRORERROR'
2018-11-30 09:09:14 [DEBUG   ] Got command RPT from MCS: ref #675945
2018-11-30 09:09:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675945  77 58452 32954869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:09:15 [DEBUG   ] Got command RPT from MCS: ref #675946
2018-11-30 09:09:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675946  12 58452 32955061 A  ERRORB—™š'
2018-11-30 09:09:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:09:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:09:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 09:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:10:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:10:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:10:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:10:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:10:12 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-30 09:10:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:10:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:10:49 [DEBUG   ] Got command RPT from MCS: ref #675947
2018-11-30 09:10:49 [DEBUG   ] summary = ERROR
2018-11-30 09:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675947  13 58452 33049973 A  ERRORERROR'
2018-11-30 09:10:49 [DEBUG   ] Got command RPT from MCS: ref #675948
2018-11-30 09:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675948  77 58452 33049974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:10:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:11:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:11:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:11:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:11:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:11:12 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-11-30 09:11:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:11:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:11:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:12:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 09:12:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:12:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:12:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:12:12 [WARNING ] (13, 1, 'bot')
2018-11-30 09:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:12:12 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-11-30 09:12:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:12:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:12:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:13:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:13:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:13:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:13:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:13:13 [DEBUG   ] Finished updating board flags in 2.248 seconds
2018-11-30 09:13:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 09:13:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 09:14:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 09:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:14:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:14:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:14:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:14:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:14:13 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-11-30 09:14:14 [DEBUG   ] Got command RPT from MCS: ref #675970
2018-11-30 09:14:14 [DEBUG   ] summary = ERROR
2018-11-30 09:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675970  13 58452 33254341 A  ERRORERROR'
2018-11-30 09:14:14 [DEBUG   ] Got command RPT from MCS: ref #675971
2018-11-30 09:14:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675971  77 58452 33254545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:14:14 [DEBUG   ] Got command RPT from MCS: ref #675972
2018-11-30 09:14:14 [DEBUG   ] summary = ERROR
2018-11-30 09:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675972  13 58452 33254749 A  ERRORERROR'
2018-11-30 09:14:14 [DEBUG   ] Got command RPT from MCS: ref #675974
2018-11-30 09:14:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675974  77 58452 33254953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:14:15 [DEBUG   ] Got command RPT from MCS: ref #675975
2018-11-30 09:14:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675975  12 58452 33255145 A  ERRORB—™š'
2018-11-30 09:14:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 09:14:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 09:15:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 09:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:15:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:15:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:15:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:15:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:15:13 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-30 09:15:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 09:15:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:15:49 [DEBUG   ] Got command RPT from MCS: ref #675984
2018-11-30 09:15:49 [DEBUG   ] summary = ERROR
2018-11-30 09:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675984  13 58452 33349969 A  ERRORERROR'
2018-11-30 09:15:49 [DEBUG   ] Got command RPT from MCS: ref #675985
2018-11-30 09:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675985  77 58452 33349970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:16:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:16:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:16:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:16:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:16:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:16:13 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-11-30 09:16:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 09:16:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 09:17:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:17:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:17:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:17:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:17:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:17:13 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 09:17:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:17:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:18:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 09:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:18:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:18:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:18:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:18:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:18:13 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-11-30 09:18:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 09:18:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 09:19:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-30 09:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:19:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:19:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:19:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:19:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:19:13 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-30 09:19:14 [DEBUG   ] Got command RPT from MCS: ref #676005
2018-11-30 09:19:14 [DEBUG   ] summary = ERROR
2018-11-30 09:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676005  13 58452 33554437 A  ERRORERROR'
2018-11-30 09:19:14 [DEBUG   ] Got command RPT from MCS: ref #676006
2018-11-30 09:19:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676006  77 58452 33554629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:19:14 [DEBUG   ] Got command RPT from MCS: ref #676007
2018-11-30 09:19:14 [DEBUG   ] summary = ERROR
2018-11-30 09:19:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676007  13 58452 33554833 A  ERRORERROR'
2018-11-30 09:19:15 [DEBUG   ] Got command RPT from MCS: ref #676008
2018-11-30 09:19:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:19:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676008  77 58452 33555037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:19:15 [DEBUG   ] Got command RPT from MCS: ref #676009
2018-11-30 09:19:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:19:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676009  12 58452 33555241 A  ERRORB–™š'
2018-11-30 09:19:21 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-30 09:19:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 09:20:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 09:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:20:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:20:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:20:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:20:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:20:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:20:13 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-11-30 09:20:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 09:20:41 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-30 09:20:49 [DEBUG   ] Got command RPT from MCS: ref #676014
2018-11-30 09:20:49 [DEBUG   ] summary = ERROR
2018-11-30 09:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676014  13 58452 33649973 A  ERRORERROR'
2018-11-30 09:20:49 [DEBUG   ] Got command RPT from MCS: ref #676015
2018-11-30 09:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676015  77 58452 33649974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:21:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:21:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:21:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:21:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:21:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:21:13 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-30 09:21:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:21:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-30 09:22:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-30 09:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:22:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:22:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:22:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:22:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:22:13 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-11-30 09:22:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:22:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:23:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-11-30 09:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:23:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:23:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:23:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:23:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:23:13 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-11-30 09:23:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-30 09:23:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 09:24:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 09:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:24:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:24:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:24:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:24:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:24:13 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-30 09:24:14 [DEBUG   ] Got command RPT from MCS: ref #676037
2018-11-30 09:24:14 [DEBUG   ] summary = ERROR
2018-11-30 09:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676037  13 58452 33854521 A  ERRORERROR'
2018-11-30 09:24:14 [DEBUG   ] Got command RPT from MCS: ref #676038
2018-11-30 09:24:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676038  77 58452 33854725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:24:14 [DEBUG   ] Got command RPT from MCS: ref #676039
2018-11-30 09:24:14 [DEBUG   ] summary = ERROR
2018-11-30 09:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676039  13 58452 33854917 A  ERRORERROR'
2018-11-30 09:24:15 [DEBUG   ] Got command RPT from MCS: ref #676041
2018-11-30 09:24:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676041  77 58452 33855121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:24:15 [DEBUG   ] Got command RPT from MCS: ref #676042
2018-11-30 09:24:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676042  12 58452 33855325 A  ERRORB–™š'
2018-11-30 09:24:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 09:24:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 09:25:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 09:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:25:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:25:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:25:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:25:13 [WARNING ] (13, 1, 'bot')
2018-11-30 09:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:25:13 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-11-30 09:25:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:25:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:25:49 [DEBUG   ] Got command RPT from MCS: ref #676047
2018-11-30 09:25:49 [DEBUG   ] summary = ERROR
2018-11-30 09:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676047  13 58452 33949969 A  ERRORERROR'
2018-11-30 09:25:49 [DEBUG   ] Got command RPT from MCS: ref #676048
2018-11-30 09:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676048  77 58452 33949970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:26:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:26:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:26:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:26:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:26:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:26:14 [DEBUG   ] Finished updating board flags in 2.266 seconds
2018-11-30 09:26:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:26:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 09:27:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:27:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:27:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:27:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:27:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:27:14 [DEBUG   ] Finished updating board flags in 2.118 seconds
2018-11-30 09:27:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:27:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 09:28:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:28:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:28:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:28:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:28:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:28:14 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-11-30 09:28:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:28:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:29:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:29:14 [DEBUG   ] Got command RPT from MCS: ref #676068
2018-11-30 09:29:14 [DEBUG   ] summary = ERROR
2018-11-30 09:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676068  13 58452 34154610 A  ERRORERROR'
2018-11-30 09:29:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:29:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:29:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:29:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:29:14 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-11-30 09:29:14 [DEBUG   ] Got command RPT from MCS: ref #676069
2018-11-30 09:29:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676069  77 58452 34154801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:29:15 [DEBUG   ] Got command RPT from MCS: ref #676070
2018-11-30 09:29:15 [DEBUG   ] summary = ERROR
2018-11-30 09:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676070  13 58452 34155005 A  ERRORERROR'
2018-11-30 09:29:15 [DEBUG   ] Got command RPT from MCS: ref #676071
2018-11-30 09:29:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676071  77 58452 34155209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:29:15 [DEBUG   ] Got command RPT from MCS: ref #676072
2018-11-30 09:29:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676072  12 58452 34155413 A  ERRORB˜™š'
2018-11-30 09:29:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 09:29:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 09:30:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 09:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 09:30:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:30:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:30:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:30:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:30:14 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-30 09:30:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:30:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:30:49 [DEBUG   ] Got command RPT from MCS: ref #676077
2018-11-30 09:30:49 [DEBUG   ] summary = ERROR
2018-11-30 09:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676077  13 58452 34249969 A  ERRORERROR'
2018-11-30 09:30:49 [DEBUG   ] Got command RPT from MCS: ref #676078
2018-11-30 09:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676078  77 58452 34249970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:31:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 09:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:31:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:31:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:31:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:31:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:31:14 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-11-30 09:31:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:31:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 09:32:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:32:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:32:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:32:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:32:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:32:14 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-30 09:32:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:32:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:33:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 09:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:33:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:33:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:33:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:33:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:33:14 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-11-30 09:33:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:33:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:34:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:34:14 [DEBUG   ] Got command RPT from MCS: ref #676100
2018-11-30 09:34:14 [DEBUG   ] summary = ERROR
2018-11-30 09:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676100  13 58452 34454689 A  ERRORERROR'
2018-11-30 09:34:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:34:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:34:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:34:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:34:14 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-30 09:34:14 [DEBUG   ] Got command RPT from MCS: ref #676101
2018-11-30 09:34:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676101  77 58452 34454893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:34:15 [DEBUG   ] Got command RPT from MCS: ref #676102
2018-11-30 09:34:15 [DEBUG   ] summary = ERROR
2018-11-30 09:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676102  13 58452 34455097 A  ERRORERROR'
2018-11-30 09:34:15 [DEBUG   ] Got command RPT from MCS: ref #676104
2018-11-30 09:34:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676104  77 58452 34455289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:34:15 [DEBUG   ] Got command RPT from MCS: ref #676106
2018-11-30 09:34:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676106  12 58452 34455493 A  ERRORB—™š'
2018-11-30 09:34:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:34:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:35:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:35:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 09:35:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:35:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:35:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:35:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:35:14 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-11-30 09:35:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 09:35:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 09:35:49 [DEBUG   ] Got command RPT from MCS: ref #676114
2018-11-30 09:35:49 [DEBUG   ] summary = ERROR
2018-11-30 09:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676114  13 58452 34549977 A  ERRORERROR'
2018-11-30 09:35:49 [DEBUG   ] Got command RPT from MCS: ref #676115
2018-11-30 09:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676115  77 58452 34549978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:36:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 09:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:36:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:36:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:36:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:36:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:36:14 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-30 09:36:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 09:36:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:37:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:37:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:37:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:37:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:37:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:37:14 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-30 09:37:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:37:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 09:38:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 09:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:38:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 09:38:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:38:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:38:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:38:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:38:14 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-11-30 09:38:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:39:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 09:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:39:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:39:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:39:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:39:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:39:14 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-11-30 09:39:14 [DEBUG   ] Got command RPT from MCS: ref #676135
2018-11-30 09:39:14 [DEBUG   ] summary = ERROR
2018-11-30 09:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676135  13 58452 34754777 A  ERRORERROR'
2018-11-30 09:39:14 [DEBUG   ] Got command RPT from MCS: ref #676136
2018-11-30 09:39:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676136  77 58452 34754981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:39:15 [DEBUG   ] Got command RPT from MCS: ref #676137
2018-11-30 09:39:15 [DEBUG   ] summary = ERROR
2018-11-30 09:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676137  13 58452 34755173 A  ERRORERROR'
2018-11-30 09:39:15 [DEBUG   ] Got command RPT from MCS: ref #676138
2018-11-30 09:39:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676138  77 58452 34755377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:39:15 [DEBUG   ] Got command RPT from MCS: ref #676139
2018-11-30 09:39:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676139  12 58452 34755581 A  ERRORB–™š'
2018-11-30 09:39:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:39:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:40:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:40:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:40:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:40:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:40:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:40:14 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-30 09:40:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:40:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 09:40:49 [DEBUG   ] Got command RPT from MCS: ref #676140
2018-11-30 09:40:49 [DEBUG   ] summary = ERROR
2018-11-30 09:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676140  13 58452 34849981 A  ERRORERROR'
2018-11-30 09:40:49 [DEBUG   ] Got command RPT from MCS: ref #676141
2018-11-30 09:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676141  77 58452 34849982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:41:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 09:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:41:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:41:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:41:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:41:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:41:14 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-11-30 09:41:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 09:41:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 09:42:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:42:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 09:42:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:42:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:42:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:42:14 [WARNING ] (13, 1, 'bot')
2018-11-30 09:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:42:14 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-11-30 09:42:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:42:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 09:43:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 09:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:43:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:43:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:43:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:43:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:43:15 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-11-30 09:43:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:43:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 09:44:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:44:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 09:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:44:14 [DEBUG   ] Got command RPT from MCS: ref #676163
2018-11-30 09:44:14 [DEBUG   ] summary = ERROR
2018-11-30 09:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676163  13 58452 35054861 A  ERRORERROR'
2018-11-30 09:44:15 [DEBUG   ] Got command RPT from MCS: ref #676164
2018-11-30 09:44:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676164  77 58452 35055057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:44:15 [DEBUG   ] Got command RPT from MCS: ref #676165
2018-11-30 09:44:15 [DEBUG   ] summary = ERROR
2018-11-30 09:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676165  13 58452 35055262 A  ERRORERROR'
2018-11-30 09:44:15 [DEBUG   ] Got command RPT from MCS: ref #676167
2018-11-30 09:44:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676167  77 58452 35055465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:44:15 [DEBUG   ] Got command RPT from MCS: ref #676168
2018-11-30 09:44:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676168  12 58452 35055670 A  ERRORB˜™š'
2018-11-30 09:44:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:44:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:44:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:44:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:44:15 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-30 09:44:25 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-30 09:44:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 09:45:06 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 09:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:45:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:45:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:45:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:45:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:45:15 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-11-30 09:45:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 09:45:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 09:45:49 [DEBUG   ] Got command RPT from MCS: ref #676177
2018-11-30 09:45:49 [DEBUG   ] summary = ERROR
2018-11-30 09:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676177  13 58452 35149981 A  ERRORERROR'
2018-11-30 09:45:49 [DEBUG   ] Got command RPT from MCS: ref #676178
2018-11-30 09:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676178  77 58452 35149982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:46:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 09:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:46:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:46:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:46:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:46:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:46:15 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-30 09:46:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:46:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:47:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 09:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 09:47:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:47:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:47:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:47:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:47:15 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-30 09:47:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:47:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 09:48:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:48:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:48:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:48:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:48:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:48:15 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-11-30 09:48:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:48:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 09:49:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:49:14 [DEBUG   ] Got command RPT from MCS: ref #676198
2018-11-30 09:49:14 [DEBUG   ] summary = ERROR
2018-11-30 09:49:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676198  13 58452 35354945 A  ERRORERROR'
2018-11-30 09:49:15 [DEBUG   ] Got command RPT from MCS: ref #676199
2018-11-30 09:49:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676199  77 58452 35355149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:49:15 [DEBUG   ] Got command RPT from MCS: ref #676200
2018-11-30 09:49:15 [DEBUG   ] summary = ERROR
2018-11-30 09:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676200  13 58452 35355353 A  ERRORERROR'
2018-11-30 09:49:15 [DEBUG   ] Got command RPT from MCS: ref #676201
2018-11-30 09:49:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676201  77 58452 35355545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:49:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:49:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:49:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:49:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:49:15 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-30 09:49:15 [DEBUG   ] Got command RPT from MCS: ref #676202
2018-11-30 09:49:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676202  12 58452 35355753 A  ERRORB—™š'
2018-11-30 09:49:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-30 09:49:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 09:50:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 09:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:50:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:50:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:50:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:50:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:50:15 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-11-30 09:50:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 09:50:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 09:50:49 [DEBUG   ] Got command RPT from MCS: ref #676207
2018-11-30 09:50:49 [DEBUG   ] summary = ERROR
2018-11-30 09:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676207  13 58452 35449981 A  ERRORERROR'
2018-11-30 09:50:49 [DEBUG   ] Got command RPT from MCS: ref #676208
2018-11-30 09:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676208  77 58452 35449982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:51:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 09:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:51:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:51:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:51:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:51:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:51:15 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-30 09:51:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 09:51:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 09:52:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 09:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:52:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:52:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:52:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:52:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:52:15 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-30 09:52:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 09:52:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 09:53:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:53:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:53:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:53:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:53:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:53:15 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-11-30 09:53:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 09:53:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 09:54:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:54:15 [DEBUG   ] Got command RPT from MCS: ref #676230
2018-11-30 09:54:15 [DEBUG   ] summary = ERROR
2018-11-30 09:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676230  13 58452 35655034 A  ERRORERROR'
2018-11-30 09:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:54:15 [DEBUG   ] Got command RPT from MCS: ref #676231
2018-11-30 09:54:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676231  77 58452 35655237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:54:15 [DEBUG   ] Got command RPT from MCS: ref #676232
2018-11-30 09:54:15 [DEBUG   ] summary = ERROR
2018-11-30 09:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676232  13 58452 35655429 A  ERRORERROR'
2018-11-30 09:54:15 [DEBUG   ] Got command RPT from MCS: ref #676234
2018-11-30 09:54:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676234  77 58452 35655633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:54:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:54:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:54:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:54:15 [WARNING ] (13, 1, 'bot')
2018-11-30 09:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:54:15 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-11-30 09:54:15 [DEBUG   ] Got command RPT from MCS: ref #676235
2018-11-30 09:54:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676235  12 58452 35655837 A  ERRORB–™š'
2018-11-30 09:54:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:54:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:55:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:55:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:55:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:55:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:55:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:55:16 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-11-30 09:55:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:55:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 09:55:49 [DEBUG   ] Got command RPT from MCS: ref #676240
2018-11-30 09:55:50 [DEBUG   ] summary = ERROR
2018-11-30 09:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676240  13 58452 35750040 A  ERRORERROR'
2018-11-30 09:55:50 [DEBUG   ] Got command RPT from MCS: ref #676241
2018-11-30 09:55:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676241  77 58452 35750040 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:56:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 09:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:56:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:56:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:56:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:56:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:56:16 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-11-30 09:56:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 09:56:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 09:57:07 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-11-30 09:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:57:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:57:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:57:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:57:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:57:16 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-11-30 09:57:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 09:57:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-30 09:58:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 09:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 09:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:58:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:58:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:58:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:58:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:58:16 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-30 09:58:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 09:58:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 09:59:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 09:59:15 [DEBUG   ] Got command RPT from MCS: ref #676261
2018-11-30 09:59:15 [DEBUG   ] summary = ERROR
2018-11-30 09:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676261  13 58452 35955121 A  ERRORERROR'
2018-11-30 09:59:15 [DEBUG   ] Got command RPT from MCS: ref #676262
2018-11-30 09:59:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676262  77 58452 35955313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:59:15 [DEBUG   ] Got command RPT from MCS: ref #676263
2018-11-30 09:59:15 [DEBUG   ] summary = ERROR
2018-11-30 09:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676263  13 58452 35955517 A  ERRORERROR'
2018-11-30 09:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 09:59:15 [DEBUG   ] Got command RPT from MCS: ref #676264
2018-11-30 09:59:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 09:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676264  77 58452 35955725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 09:59:15 [DEBUG   ] Got command RPT from MCS: ref #676265
2018-11-30 09:59:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 09:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676265  12 58452 35955917 A  ERRORBŽÌÍ'
2018-11-30 09:59:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:59:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:59:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:59:16 [WARNING ] (13, 1, 'bot')
2018-11-30 09:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 09:59:16 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-11-30 09:59:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 09:59:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 10:00:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 10:00:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:00:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:00:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:00:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:00:16 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-30 10:00:28 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2018-11-30 10:00:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:00:49 [DEBUG   ] Got command RPT from MCS: ref #676270
2018-11-30 10:00:49 [DEBUG   ] summary = ERROR
2018-11-30 10:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676270  13 58452 36049985 A  ERRORERROR'
2018-11-30 10:00:49 [DEBUG   ] Got command RPT from MCS: ref #676271
2018-11-30 10:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676271  77 58452 36049986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:01:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 10:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:01:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:01:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:01:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:01:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:01:16 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-30 10:01:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:01:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 10:02:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 10:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:02:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:02:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:02:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:02:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:02:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:02:16 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-30 10:02:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:02:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:03:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:03:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:03:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:03:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:03:16 [WARNING ] (13, 1, 'bot')
2018-11-30 10:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:03:16 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-30 10:03:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 10:03:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 10:04:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 10:04:15 [DEBUG   ] Got command RPT from MCS: ref #676293
2018-11-30 10:04:15 [DEBUG   ] summary = ERROR
2018-11-30 10:04:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676293  13 58452 36255205 A  ERRORERROR'
2018-11-30 10:04:15 [DEBUG   ] Got command RPT from MCS: ref #676294
2018-11-30 10:04:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:04:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676294  77 58452 36255409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:04:15 [DEBUG   ] Got command RPT from MCS: ref #676295
2018-11-30 10:04:15 [DEBUG   ] summary = ERROR
2018-11-30 10:04:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676295  13 58452 36255601 A  ERRORERROR'
2018-11-30 10:04:15 [DEBUG   ] Got command RPT from MCS: ref #676297
2018-11-30 10:04:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:04:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676297  77 58452 36255805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:04:16 [DEBUG   ] Got command RPT from MCS: ref #676299
2018-11-30 10:04:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676299  12 58452 36256009 A  ERRORB˜™š'
2018-11-30 10:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:04:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:04:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:04:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:04:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:04:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:04:17 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-11-30 10:04:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 10:04:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:05:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:05:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:05:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:05:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:05:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:05:17 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-30 10:05:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:05:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:05:49 [DEBUG   ] Got command RPT from MCS: ref #676307
2018-11-30 10:05:49 [DEBUG   ] summary = ERROR
2018-11-30 10:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676307  13 58452 36349981 A  ERRORERROR'
2018-11-30 10:05:49 [DEBUG   ] Got command RPT from MCS: ref #676308
2018-11-30 10:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676308  77 58452 36349982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:06:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 10:06:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 10:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:06:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:06:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:06:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:06:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:06:17 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-11-30 10:06:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:06:49 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-30 10:07:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:07:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:07:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:07:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:07:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:07:17 [DEBUG   ] Finished updating board flags in 1.729 seconds
2018-11-30 10:07:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:07:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-30 10:08:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 10:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:08:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:08:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:08:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:08:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:08:17 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-11-30 10:08:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:08:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:09:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:09:15 [DEBUG   ] Got command RPT from MCS: ref #676328
2018-11-30 10:09:15 [DEBUG   ] summary = ERROR
2018-11-30 10:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676328  13 58452 36555289 A  ERRORERROR'
2018-11-30 10:09:15 [DEBUG   ] Got command RPT from MCS: ref #676329
2018-11-30 10:09:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676329  77 58452 36555493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:09:15 [DEBUG   ] Got command RPT from MCS: ref #676330
2018-11-30 10:09:15 [DEBUG   ] summary = ERROR
2018-11-30 10:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676330  13 58452 36555697 A  ERRORERROR'
2018-11-30 10:09:15 [DEBUG   ] Got command RPT from MCS: ref #676331
2018-11-30 10:09:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676331  77 58452 36555889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:09:16 [DEBUG   ] Got command RPT from MCS: ref #676332
2018-11-30 10:09:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676332  12 58452 36556093 A  ERRORB—™š'
2018-11-30 10:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:09:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:09:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:09:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:09:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:09:17 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-11-30 10:09:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 10:09:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 10:10:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 10:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:10:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:10:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:10:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:10:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:10:17 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-11-30 10:10:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 10:10:49 [DEBUG   ] Got command RPT from MCS: ref #676333
2018-11-30 10:10:49 [DEBUG   ] summary = ERROR
2018-11-30 10:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676333  13 58452 36649985 A  ERRORERROR'
2018-11-30 10:10:49 [DEBUG   ] Got command RPT from MCS: ref #676334
2018-11-30 10:10:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676334  77 58452 36649986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:10:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 10:11:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 10:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:11:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:11:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:11:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:11:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:11:17 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-30 10:11:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 10:11:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 10:12:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:12:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 10:12:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:12:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:12:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:12:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:12:17 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-30 10:12:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:12:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 10:13:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:13:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 10:13:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:13:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:13:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:13:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:13:17 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-30 10:13:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:13:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 10:14:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 10:14:15 [DEBUG   ] Got command RPT from MCS: ref #676356
2018-11-30 10:14:15 [DEBUG   ] summary = ERROR
2018-11-30 10:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676356  13 58452 36855377 A  ERRORERROR'
2018-11-30 10:14:15 [DEBUG   ] Got command RPT from MCS: ref #676357
2018-11-30 10:14:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676357  77 58452 36855581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:14:15 [DEBUG   ] Got command RPT from MCS: ref #676358
2018-11-30 10:14:15 [DEBUG   ] summary = ERROR
2018-11-30 10:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676358  13 58452 36855773 A  ERRORERROR'
2018-11-30 10:14:15 [DEBUG   ] Got command RPT from MCS: ref #676360
2018-11-30 10:14:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676360  77 58452 36855977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:14:16 [DEBUG   ] Got command RPT from MCS: ref #676361
2018-11-30 10:14:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676361  12 58452 36856181 A  ERRORB–™š'
2018-11-30 10:14:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 10:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:14:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:14:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:14:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:14:17 [WARNING ] (13, 1, 'bot')
2018-11-30 10:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:14:17 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-30 10:14:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:14:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:15:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:15:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:15:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:15:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:15:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:15:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:15:18 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-11-30 10:15:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:15:49 [DEBUG   ] Got command RPT from MCS: ref #676370
2018-11-30 10:15:49 [DEBUG   ] summary = ERROR
2018-11-30 10:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676370  13 58452 36949990 A  ERRORERROR'
2018-11-30 10:15:49 [DEBUG   ] Got command RPT from MCS: ref #676371
2018-11-30 10:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676371  77 58452 36949990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:15:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 10:16:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 10:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:16:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:16:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:16:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:16:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:16:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:16:18 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-30 10:16:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 10:16:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 10:17:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 10:17:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 10:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:17:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:17:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:17:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:17:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:17:18 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-11-30 10:17:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 10:17:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 10:18:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:18:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:18:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:18:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:18:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:18:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:18:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:18:18 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-30 10:18:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 10:18:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:19:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:19:15 [DEBUG   ] Got command RPT from MCS: ref #676391
2018-11-30 10:19:15 [DEBUG   ] summary = ERROR
2018-11-30 10:19:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676391  13 58452 37155461 A  ERRORERROR'
2018-11-30 10:19:15 [DEBUG   ] Got command RPT from MCS: ref #676392
2018-11-30 10:19:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:19:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676392  77 58452 37155665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:19:15 [DEBUG   ] Got command RPT from MCS: ref #676393
2018-11-30 10:19:15 [DEBUG   ] summary = ERROR
2018-11-30 10:19:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676393  13 58452 37155869 A  ERRORERROR'
2018-11-30 10:19:16 [DEBUG   ] Got command RPT from MCS: ref #676394
2018-11-30 10:19:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676394  77 58452 37156073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:19:16 [DEBUG   ] Got command RPT from MCS: ref #676395
2018-11-30 10:19:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676395  12 58452 37156265 A  ERRORB˜™š'
2018-11-30 10:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:19:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:19:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:19:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:19:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:19:18 [DEBUG   ] Finished updating board flags in 1.655 seconds
2018-11-30 10:19:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:19:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:20:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:20:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:20:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:20:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:20:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:20:18 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-30 10:20:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 10:20:49 [DEBUG   ] Got command RPT from MCS: ref #676400
2018-11-30 10:20:49 [DEBUG   ] summary = ERROR
2018-11-30 10:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676400  13 58452 37249985 A  ERRORERROR'
2018-11-30 10:20:49 [DEBUG   ] Got command RPT from MCS: ref #676401
2018-11-30 10:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676401  77 58452 37249986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:20:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:21:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:21:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:21:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:21:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:21:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:21:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:21:18 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-11-30 10:21:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:21:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:22:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:22:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:22:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:22:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:22:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:22:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:22:18 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-11-30 10:22:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:22:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:23:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 10:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:23:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:23:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:23:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:23:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:23:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:23:18 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-11-30 10:23:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:23:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:24:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:24:15 [DEBUG   ] Got command RPT from MCS: ref #676423
2018-11-30 10:24:15 [DEBUG   ] summary = ERROR
2018-11-30 10:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676423  13 58452 37455557 A  ERRORERROR'
2018-11-30 10:24:15 [DEBUG   ] Got command RPT from MCS: ref #676424
2018-11-30 10:24:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676424  77 58452 37455749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:24:15 [DEBUG   ] Got command RPT from MCS: ref #676425
2018-11-30 10:24:15 [DEBUG   ] summary = ERROR
2018-11-30 10:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676425  13 58452 37455953 A  ERRORERROR'
2018-11-30 10:24:16 [DEBUG   ] Got command RPT from MCS: ref #676427
2018-11-30 10:24:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676427  77 58452 37456157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:24:16 [DEBUG   ] Got command RPT from MCS: ref #676428
2018-11-30 10:24:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676428  12 58452 37456361 A  ERRORB—™š'
2018-11-30 10:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:24:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:24:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:24:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:24:18 [WARNING ] (13, 1, 'bot')
2018-11-30 10:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:24:18 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-11-30 10:24:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:24:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 10:25:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 10:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:25:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:25:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:25:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:25:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:25:19 [DEBUG   ] Finished updating board flags in 2.150 seconds
2018-11-30 10:25:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 10:25:49 [DEBUG   ] Got command RPT from MCS: ref #676433
2018-11-30 10:25:49 [DEBUG   ] summary = ERROR
2018-11-30 10:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676433  13 58452 37549985 A  ERRORERROR'
2018-11-30 10:25:49 [DEBUG   ] Got command RPT from MCS: ref #676434
2018-11-30 10:25:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:25:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676434  77 58452 37549986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:25:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:26:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:26:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:26:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:26:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:26:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:26:19 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-30 10:26:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:26:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 10:27:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:27:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 10:27:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:27:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:27:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:27:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:27:19 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-11-30 10:27:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 10:27:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:28:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:28:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:28:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:28:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:28:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:28:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:28:19 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-30 10:28:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:28:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:29:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:29:15 [DEBUG   ] Got command RPT from MCS: ref #676454
2018-11-30 10:29:15 [DEBUG   ] summary = ERROR
2018-11-30 10:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676454  13 58452 37755633 A  ERRORERROR'
2018-11-30 10:29:15 [DEBUG   ] Got command RPT from MCS: ref #676455
2018-11-30 10:29:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676455  77 58452 37755837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:29:16 [DEBUG   ] Got command RPT from MCS: ref #676456
2018-11-30 10:29:16 [DEBUG   ] summary = ERROR
2018-11-30 10:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676456  13 58452 37756041 A  ERRORERROR'
2018-11-30 10:29:16 [DEBUG   ] Got command RPT from MCS: ref #676457
2018-11-30 10:29:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676457  77 58452 37756245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:29:16 [DEBUG   ] Got command RPT from MCS: ref #676458
2018-11-30 10:29:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676458  12 58452 37756437 A  ERRORB–™š'
2018-11-30 10:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:29:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:29:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:29:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:29:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:29:19 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-11-30 10:29:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:29:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 10:30:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 10:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:30:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:30:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:30:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:30:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:30:19 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-11-30 10:30:32 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-11-30 10:30:49 [DEBUG   ] Got command RPT from MCS: ref #676463
2018-11-30 10:30:49 [DEBUG   ] summary = ERROR
2018-11-30 10:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676463  13 58452 37849989 A  ERRORERROR'
2018-11-30 10:30:49 [DEBUG   ] Got command RPT from MCS: ref #676464
2018-11-30 10:30:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:30:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676464  77 58452 37849990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:30:52 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-30 10:31:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 10:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:31:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:31:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:31:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:31:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:31:19 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-30 10:31:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 10:31:53 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 10:32:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 10:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:32:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:32:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:32:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:32:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:32:19 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-30 10:32:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:32:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 10:33:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:33:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 10:33:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:33:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:33:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:33:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:33:19 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-30 10:33:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:33:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:34:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:34:15 [DEBUG   ] Got command RPT from MCS: ref #676486
2018-11-30 10:34:15 [DEBUG   ] summary = ERROR
2018-11-30 10:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676486  13 58452 38055729 A  ERRORERROR'
2018-11-30 10:34:15 [DEBUG   ] Got command RPT from MCS: ref #676487
2018-11-30 10:34:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676487  77 58452 38055921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:34:16 [DEBUG   ] Got command RPT from MCS: ref #676488
2018-11-30 10:34:16 [DEBUG   ] summary = ERROR
2018-11-30 10:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676488  13 58452 38056125 A  ERRORERROR'
2018-11-30 10:34:16 [DEBUG   ] Got command RPT from MCS: ref #676490
2018-11-30 10:34:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676490  77 58452 38056329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:34:16 [DEBUG   ] Got command RPT from MCS: ref #676491
2018-11-30 10:34:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676491  12 58452 38056533 A  ERRORB–™š'
2018-11-30 10:34:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:34:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:34:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:34:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:34:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:34:19 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-11-30 10:34:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 10:34:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:35:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:35:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:35:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:35:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:35:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:35:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:35:19 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-11-30 10:35:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 10:35:49 [DEBUG   ] Got command RPT from MCS: ref #676500
2018-11-30 10:35:49 [DEBUG   ] summary = ERROR
2018-11-30 10:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676500  13 58452 38149993 A  ERRORERROR'
2018-11-30 10:35:49 [DEBUG   ] Got command RPT from MCS: ref #676501
2018-11-30 10:35:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:35:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676501  77 58452 38149994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:35:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 10:36:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 10:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:36:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:36:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:36:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:36:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:36:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:36:19 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-11-30 10:36:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 10:36:54 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-30 10:37:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 10:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:37:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:37:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:37:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:37:19 [WARNING ] (13, 1, 'bot')
2018-11-30 10:37:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:37:19 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-11-30 10:37:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 10:37:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 10:38:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 10:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:38:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:38:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:38:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:38:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:38:20 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-11-30 10:38:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:38:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 10:39:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 10:39:15 [DEBUG   ] Got command RPT from MCS: ref #676521
2018-11-30 10:39:15 [DEBUG   ] summary = ERROR
2018-11-30 10:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676521  13 58452 38355809 A  ERRORERROR'
2018-11-30 10:39:16 [DEBUG   ] Got command RPT from MCS: ref #676522
2018-11-30 10:39:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676522  77 58452 38356013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:39:16 [DEBUG   ] Got command RPT from MCS: ref #676523
2018-11-30 10:39:16 [DEBUG   ] summary = ERROR
2018-11-30 10:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676523  13 58452 38356217 A  ERRORERROR'
2018-11-30 10:39:16 [DEBUG   ] Got command RPT from MCS: ref #676524
2018-11-30 10:39:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676524  77 58452 38356421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:39:16 [DEBUG   ] Got command RPT from MCS: ref #676525
2018-11-30 10:39:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676525  12 58452 38356613 A  ERRORB—™š'
2018-11-30 10:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:39:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:39:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:39:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:39:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:39:20 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-11-30 10:39:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-30 10:39:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:40:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:40:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:40:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:40:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:40:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:40:20 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-11-30 10:40:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 10:40:49 [DEBUG   ] Got command RPT from MCS: ref #676526
2018-11-30 10:40:49 [DEBUG   ] summary = ERROR
2018-11-30 10:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676526  13 58452 38449986 A  ERRORERROR'
2018-11-30 10:40:49 [DEBUG   ] Got command RPT from MCS: ref #676527
2018-11-30 10:40:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:40:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676527  77 58452 38449986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:40:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:41:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:41:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:41:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:41:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:41:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:41:20 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-30 10:41:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 10:41:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:42:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 10:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:42:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:42:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:42:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:42:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:42:20 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-30 10:42:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 10:42:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-30 10:43:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 10:43:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:43:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:43:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:43:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:43:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:43:20 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-30 10:43:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 10:43:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 10:44:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 10:44:15 [DEBUG   ] Got command RPT from MCS: ref #676549
2018-11-30 10:44:15 [DEBUG   ] summary = ERROR
2018-11-30 10:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676549  13 58452 38655905 A  ERRORERROR'
2018-11-30 10:44:16 [DEBUG   ] Got command RPT from MCS: ref #676550
2018-11-30 10:44:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676550  77 58452 38656097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:44:16 [DEBUG   ] Got command RPT from MCS: ref #676551
2018-11-30 10:44:16 [DEBUG   ] summary = ERROR
2018-11-30 10:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676551  13 58452 38656301 A  ERRORERROR'
2018-11-30 10:44:16 [DEBUG   ] Got command RPT from MCS: ref #676553
2018-11-30 10:44:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676553  77 58452 38656505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:44:16 [DEBUG   ] Got command RPT from MCS: ref #676555
2018-11-30 10:44:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676555  12 58452 38656697 A  ERRORB–™š'
2018-11-30 10:44:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:44:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:44:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:44:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:44:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:44:20 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-11-30 10:44:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:44:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:45:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:45:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:45:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:45:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:45:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:45:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:45:20 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-30 10:45:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 10:45:49 [DEBUG   ] Got command RPT from MCS: ref #676563
2018-11-30 10:45:49 [DEBUG   ] summary = ERROR
2018-11-30 10:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676563  13 58452 38749993 A  ERRORERROR'
2018-11-30 10:45:49 [DEBUG   ] Got command RPT from MCS: ref #676564
2018-11-30 10:45:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676564  77 58452 38749994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:45:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:46:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:46:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:46:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:46:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:46:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:46:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:46:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:46:20 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-11-30 10:46:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:46:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:47:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:47:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:47:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:47:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:47:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:47:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:47:20 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-11-30 10:47:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:47:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:48:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 10:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:48:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:48:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:48:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:48:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:48:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:48:20 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-11-30 10:48:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:48:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:49:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-30 10:49:15 [DEBUG   ] Got command RPT from MCS: ref #676584
2018-11-30 10:49:15 [DEBUG   ] summary = ERROR
2018-11-30 10:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676584  13 58452 38955985 A  ERRORERROR'
2018-11-30 10:49:16 [DEBUG   ] Got command RPT from MCS: ref #676585
2018-11-30 10:49:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676585  77 58452 38956177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:49:16 [DEBUG   ] Got command RPT from MCS: ref #676586
2018-11-30 10:49:16 [DEBUG   ] summary = ERROR
2018-11-30 10:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676586  13 58452 38956381 A  ERRORERROR'
2018-11-30 10:49:16 [DEBUG   ] Got command RPT from MCS: ref #676587
2018-11-30 10:49:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676587  77 58452 38956585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:49:16 [DEBUG   ] Got command RPT from MCS: ref #676588
2018-11-30 10:49:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676588  12 58452 38956789 A  ERRORB–™š'
2018-11-30 10:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:49:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 10:49:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:49:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:49:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:49:20 [WARNING ] (13, 1, 'bot')
2018-11-30 10:49:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:49:20 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-11-30 10:49:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 10:49:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:50:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:50:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:50:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:50:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:50:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:50:21 [DEBUG   ] Finished updating board flags in 2.265 seconds
2018-11-30 10:50:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:50:49 [DEBUG   ] Got command RPT from MCS: ref #676593
2018-11-30 10:50:49 [DEBUG   ] summary = ERROR
2018-11-30 10:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676593  13 58452 39049993 A  ERRORERROR'
2018-11-30 10:50:49 [DEBUG   ] Got command RPT from MCS: ref #676594
2018-11-30 10:50:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:50:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676594  77 58452 39049994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:50:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:51:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:51:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:51:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:51:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:51:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:51:21 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-11-30 10:51:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 10:51:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:52:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:52:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:52:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:52:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:52:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:52:21 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-11-30 10:52:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 10:52:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 10:53:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 10:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:53:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 10:53:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:53:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:53:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:53:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:53:21 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-11-30 10:53:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:53:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:54:16 [DEBUG   ] Got command RPT from MCS: ref #676616
2018-11-30 10:54:16 [DEBUG   ] summary = ERROR
2018-11-30 10:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676616  13 58452 39256069 A  ERRORERROR'
2018-11-30 10:54:16 [DEBUG   ] Got command RPT from MCS: ref #676617
2018-11-30 10:54:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676617  77 58452 39256273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:54:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 10:54:16 [DEBUG   ] Got command RPT from MCS: ref #676618
2018-11-30 10:54:16 [DEBUG   ] summary = ERROR
2018-11-30 10:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676618  13 58452 39256465 A  ERRORERROR'
2018-11-30 10:54:16 [DEBUG   ] Got command RPT from MCS: ref #676620
2018-11-30 10:54:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676620  77 58452 39256669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:54:16 [DEBUG   ] Got command RPT from MCS: ref #676622
2018-11-30 10:54:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676622  12 58452 39256873 A  ERRORB˜™š'
2018-11-30 10:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:54:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:54:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:54:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:54:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:54:21 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 10:54:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 10:54:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 10:55:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 10:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:55:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:55:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:55:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:55:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:55:21 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-11-30 10:55:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 10:55:49 [DEBUG   ] Got command RPT from MCS: ref #676626
2018-11-30 10:55:49 [DEBUG   ] summary = ERROR
2018-11-30 10:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676626  13 58452 39349997 A  ERRORERROR'
2018-11-30 10:55:49 [DEBUG   ] Got command RPT from MCS: ref #676627
2018-11-30 10:55:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:55:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676627  77 58452 39349998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:55:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 10:56:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:56:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:56:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:56:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:56:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:56:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:56:21 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-30 10:56:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 10:56:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 10:57:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 10:57:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:57:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:57:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:57:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:57:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:57:21 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-11-30 10:57:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 10:57:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 10:58:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 10:58:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:58:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:58:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:58:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:58:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:58:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:58:21 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-30 10:58:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 10:58:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 10:59:16 [DEBUG   ] Got command RPT from MCS: ref #676647
2018-11-30 10:59:16 [DEBUG   ] summary = ERROR
2018-11-30 10:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676647  13 58452 39556157 A  ERRORERROR'
2018-11-30 10:59:16 [DEBUG   ] Got command RPT from MCS: ref #676648
2018-11-30 10:59:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676648  77 58452 39556362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:59:16 [DEBUG   ] Got command RPT from MCS: ref #676649
2018-11-30 10:59:16 [DEBUG   ] summary = ERROR
2018-11-30 10:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676649  13 58452 39556554 A  ERRORERROR'
2018-11-30 10:59:16 [DEBUG   ] Got command RPT from MCS: ref #676650
2018-11-30 10:59:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 10:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676650  77 58452 39556757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 10:59:16 [DEBUG   ] Got command RPT from MCS: ref #676651
2018-11-30 10:59:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 10:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676651  12 58452 39556961 A  ERRORB–™š'
2018-11-30 10:59:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 10:59:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 10:59:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:59:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:59:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:59:21 [WARNING ] (13, 1, 'bot')
2018-11-30 10:59:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 10:59:21 [DEBUG   ] Finished updating board flags in 1.525 seconds
2018-11-30 10:59:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 10:59:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:00:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:00:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:00:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:00:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:00:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:00:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:00:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:00:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:00:21 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-30 11:00:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:00:49 [DEBUG   ] Got command RPT from MCS: ref #676656
2018-11-30 11:00:49 [DEBUG   ] summary = ERROR
2018-11-30 11:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676656  13 58452 39649997 A  ERRORERROR'
2018-11-30 11:00:49 [DEBUG   ] Got command RPT from MCS: ref #676657
2018-11-30 11:00:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676657  77 58452 39649998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:00:57 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-30 11:01:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 11:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:01:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:01:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:01:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:01:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:01:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:01:21 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-30 11:01:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 11:01:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-30 11:02:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 11:02:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-30 11:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:02:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:02:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:02:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:02:21 [WARNING ] (13, 1, 'bot')
2018-11-30 11:02:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:02:21 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-11-30 11:02:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 11:02:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 11:03:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 11:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:03:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:03:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:03:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:03:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:03:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:03:22 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-11-30 11:03:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 11:03:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 11:04:16 [DEBUG   ] Got command RPT from MCS: ref #676679
2018-11-30 11:04:16 [DEBUG   ] summary = ERROR
2018-11-30 11:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676679  13 58452 39856245 A  ERRORERROR'
2018-11-30 11:04:16 [DEBUG   ] Got command RPT from MCS: ref #676680
2018-11-30 11:04:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676680  77 58452 39856437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:04:16 [DEBUG   ] Got command RPT from MCS: ref #676681
2018-11-30 11:04:16 [DEBUG   ] summary = ERROR
2018-11-30 11:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676681  13 58452 39856641 A  ERRORERROR'
2018-11-30 11:04:16 [DEBUG   ] Got command RPT from MCS: ref #676683
2018-11-30 11:04:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676683  77 58452 39856845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:04:17 [DEBUG   ] Got command RPT from MCS: ref #676685
2018-11-30 11:04:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676685  12 58452 39857049 A  ERRORB—™š'
2018-11-30 11:04:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 11:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:04:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:04:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:04:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:04:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:04:22 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-11-30 11:04:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:04:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:05:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:05:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 11:05:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:05:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:05:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:05:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:05:22 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-11-30 11:05:38 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-30 11:05:49 [DEBUG   ] Got command RPT from MCS: ref #676693
2018-11-30 11:05:49 [DEBUG   ] summary = ERROR
2018-11-30 11:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676693  13 58452 39949993 A  ERRORERROR'
2018-11-30 11:05:49 [DEBUG   ] Got command RPT from MCS: ref #676694
2018-11-30 11:05:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676694  77 58452 39949994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:05:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:06:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:06:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:06:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:06:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:06:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:06:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:06:22 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-11-30 11:06:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 11:06:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:07:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:07:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:07:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:07:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:07:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:07:22 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-30 11:07:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 11:07:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 11:08:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 11:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:08:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 11:08:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:08:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:08:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:08:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:08:22 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-30 11:08:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 11:08:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 11:09:16 [DEBUG   ] Got command RPT from MCS: ref #676714
2018-11-30 11:09:16 [DEBUG   ] summary = ERROR
2018-11-30 11:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676714  13 58452 40156329 A  ERRORERROR'
2018-11-30 11:09:16 [DEBUG   ] Got command RPT from MCS: ref #676715
2018-11-30 11:09:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676715  77 58452 40156533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:09:16 [DEBUG   ] Got command RPT from MCS: ref #676716
2018-11-30 11:09:16 [DEBUG   ] summary = ERROR
2018-11-30 11:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676716  13 58452 40156725 A  ERRORERROR'
2018-11-30 11:09:16 [DEBUG   ] Got command RPT from MCS: ref #676717
2018-11-30 11:09:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676717  77 58452 40156929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:09:17 [DEBUG   ] Got command RPT from MCS: ref #676718
2018-11-30 11:09:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676718  12 58452 40157133 A  ERRORB—™š'
2018-11-30 11:09:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 11:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 11:09:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:09:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:09:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:09:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:09:22 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-11-30 11:09:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 11:09:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 11:10:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 11:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:10:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 11:10:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:10:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:10:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:10:22 [WARNING ] (13, 1, 'bot')
2018-11-30 11:10:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:10:22 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-30 11:10:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 11:10:50 [DEBUG   ] Got command RPT from MCS: ref #676719
2018-11-30 11:10:50 [DEBUG   ] summary = ERROR
2018-11-30 11:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676719  13 58452 40250001 A  ERRORERROR'
2018-11-30 11:10:50 [DEBUG   ] Got command RPT from MCS: ref #676720
2018-11-30 11:10:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676720  77 58452 40250002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:10:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:11:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:11:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:11:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:11:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:11:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:11:23 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-11-30 11:11:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:11:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 11:12:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:12:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:12:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:12:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:12:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:12:23 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-11-30 11:12:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:12:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 11:13:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:13:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:13:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:13:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:13:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:13:23 [DEBUG   ] Finished updating board flags in 1.896 seconds
2018-11-30 11:13:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:13:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:14:16 [DEBUG   ] Got command RPT from MCS: ref #676742
2018-11-30 11:14:16 [DEBUG   ] summary = ERROR
2018-11-30 11:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676742  13 58452 40456417 A  ERRORERROR'
2018-11-30 11:14:16 [DEBUG   ] Got command RPT from MCS: ref #676743
2018-11-30 11:14:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676743  77 58452 40456609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:14:16 [DEBUG   ] Got command RPT from MCS: ref #676744
2018-11-30 11:14:16 [DEBUG   ] summary = ERROR
2018-11-30 11:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676744  13 58452 40456813 A  ERRORERROR'
2018-11-30 11:14:17 [DEBUG   ] Got command RPT from MCS: ref #676746
2018-11-30 11:14:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676746  77 58452 40457017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:14:17 [DEBUG   ] Got command RPT from MCS: ref #676747
2018-11-30 11:14:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676747  12 58452 40457221 A  ERRORB–™š'
2018-11-30 11:14:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 11:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:14:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:14:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:14:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:14:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:14:23 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-30 11:14:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 11:14:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 11:15:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-30 11:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:15:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:15:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:15:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:15:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:15:23 [DEBUG   ] Finished updating board flags in 1.705 seconds
2018-11-30 11:15:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 11:15:49 [DEBUG   ] Got command RPT from MCS: ref #676756
2018-11-30 11:15:49 [DEBUG   ] summary = ERROR
2018-11-30 11:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676756  13 58452 40549997 A  ERRORERROR'
2018-11-30 11:15:49 [DEBUG   ] Got command RPT from MCS: ref #676757
2018-11-30 11:15:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676757  77 58452 40549998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:16:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 11:16:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 11:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:16:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:16:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:16:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:16:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:16:23 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-30 11:16:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 11:17:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 11:17:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:17:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:17:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:17:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:17:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:17:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:17:23 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-30 11:17:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 11:18:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 11:18:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:18:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:18:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:18:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:18:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:18:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:18:23 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-30 11:18:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:19:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:19:16 [DEBUG   ] Got command RPT from MCS: ref #676777
2018-11-30 11:19:16 [DEBUG   ] summary = ERROR
2018-11-30 11:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676777  13 58452 40756497 A  ERRORERROR'
2018-11-30 11:19:16 [DEBUG   ] Got command RPT from MCS: ref #676778
2018-11-30 11:19:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676778  77 58452 40756701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:19:16 [DEBUG   ] Got command RPT from MCS: ref #676779
2018-11-30 11:19:16 [DEBUG   ] summary = ERROR
2018-11-30 11:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676779  13 58452 40756905 A  ERRORERROR'
2018-11-30 11:19:17 [DEBUG   ] Got command RPT from MCS: ref #676780
2018-11-30 11:19:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676780  77 58452 40757097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:19:17 [DEBUG   ] Got command RPT from MCS: ref #676781
2018-11-30 11:19:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676781  12 58452 40757301 A  ERRORB–™š'
2018-11-30 11:19:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 11:19:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:19:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:19:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:19:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:19:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:19:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:19:23 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-30 11:19:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 11:20:01 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-30 11:20:21 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 11:20:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:20:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:20:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:20:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:20:23 [WARNING ] (13, 1, 'bot')
2018-11-30 11:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:20:23 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-11-30 11:20:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 11:20:49 [DEBUG   ] Got command RPT from MCS: ref #676786
2018-11-30 11:20:49 [DEBUG   ] summary = ERROR
2018-11-30 11:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676786  13 58452 40849997 A  ERRORERROR'
2018-11-30 11:20:49 [DEBUG   ] Got command RPT from MCS: ref #676787
2018-11-30 11:20:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676787  77 58452 40849998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:21:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:21:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:21:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:21:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:21:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:21:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:21:24 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-11-30 11:21:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 11:22:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 11:22:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:22:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:22:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:22:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:22:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:22:24 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-30 11:22:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:23:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 11:23:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-30 11:23:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:23:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:23:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:23:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:23:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:23:24 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-30 11:23:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 11:24:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 11:24:16 [DEBUG   ] Got command RPT from MCS: ref #676809
2018-11-30 11:24:16 [DEBUG   ] summary = ERROR
2018-11-30 11:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676809  13 58452 41056589 A  ERRORERROR'
2018-11-30 11:24:16 [DEBUG   ] Got command RPT from MCS: ref #676810
2018-11-30 11:24:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676810  77 58452 41056781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:24:16 [DEBUG   ] Got command RPT from MCS: ref #676811
2018-11-30 11:24:16 [DEBUG   ] summary = ERROR
2018-11-30 11:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676811  13 58452 41056985 A  ERRORERROR'
2018-11-30 11:24:17 [DEBUG   ] Got command RPT from MCS: ref #676813
2018-11-30 11:24:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676813  77 58452 41057189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:24:17 [DEBUG   ] Got command RPT from MCS: ref #676815
2018-11-30 11:24:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676815  12 58452 41057393 A  ERRORB˜™š'
2018-11-30 11:24:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 11:24:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:24:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:24:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:24:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:24:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:24:24 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-11-30 11:24:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 11:25:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 11:25:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 11:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:25:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:25:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:25:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:25:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:25:24 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-11-30 11:25:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:25:50 [DEBUG   ] Got command RPT from MCS: ref #676819
2018-11-30 11:25:50 [DEBUG   ] summary = ERROR
2018-11-30 11:25:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676819  13 58452 41150001 A  ERRORERROR'
2018-11-30 11:25:50 [DEBUG   ] Got command RPT from MCS: ref #676820
2018-11-30 11:25:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:25:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676820  77 58452 41150002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:26:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:26:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:26:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:26:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:26:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:26:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:26:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:26:24 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-11-30 11:26:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 11:27:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:27:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 11:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:27:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:27:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:27:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:27:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:27:24 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-30 11:27:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-30 11:28:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:28:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:28:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:28:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:28:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:28:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:28:24 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-30 11:28:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 11:29:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 11:29:16 [DEBUG   ] Got command RPT from MCS: ref #676840
2018-11-30 11:29:16 [DEBUG   ] summary = ERROR
2018-11-30 11:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676840  13 58452 41356669 A  ERRORERROR'
2018-11-30 11:29:16 [DEBUG   ] Got command RPT from MCS: ref #676841
2018-11-30 11:29:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676841  77 58452 41356873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:29:17 [DEBUG   ] Got command RPT from MCS: ref #676842
2018-11-30 11:29:17 [DEBUG   ] summary = ERROR
2018-11-30 11:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676842  13 58452 41357077 A  ERRORERROR'
2018-11-30 11:29:17 [DEBUG   ] Got command RPT from MCS: ref #676843
2018-11-30 11:29:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676843  77 58452 41357269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:29:17 [DEBUG   ] Got command RPT from MCS: ref #676844
2018-11-30 11:29:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676844  12 58452 41357473 A  ERRORB—™š'
2018-11-30 11:29:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 11:29:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:29:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:29:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:29:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:29:24 [WARNING ] (13, 1, 'bot')
2018-11-30 11:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:29:24 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-11-30 11:29:43 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-30 11:30:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 11:30:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 11:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:30:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:30:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:30:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:30:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:30:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:30:25 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-11-30 11:30:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:30:50 [DEBUG   ] Got command RPT from MCS: ref #676849
2018-11-30 11:30:50 [DEBUG   ] summary = ERROR
2018-11-30 11:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676849  13 58452 41450001 A  ERRORERROR'
2018-11-30 11:30:50 [DEBUG   ] Got command RPT from MCS: ref #676850
2018-11-30 11:30:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676850  77 58452 41450002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:31:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:31:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:31:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:31:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:31:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:31:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:31:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:31:25 [DEBUG   ] Finished updating board flags in 2.117 seconds
2018-11-30 11:31:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 11:32:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 11:32:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 11:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:32:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 11:32:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:32:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:32:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:32:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:32:25 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-30 11:32:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 11:33:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 11:33:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:33:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:33:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:33:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:33:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:33:25 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-30 11:33:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:34:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 11:34:16 [DEBUG   ] Got command RPT from MCS: ref #676872
2018-11-30 11:34:16 [DEBUG   ] summary = ERROR
2018-11-30 11:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676872  13 58452 41656761 A  ERRORERROR'
2018-11-30 11:34:16 [DEBUG   ] Got command RPT from MCS: ref #676873
2018-11-30 11:34:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676873  77 58452 41656965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:34:17 [DEBUG   ] Got command RPT from MCS: ref #676874
2018-11-30 11:34:17 [DEBUG   ] summary = ERROR
2018-11-30 11:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676874  13 58452 41657157 A  ERRORERROR'
2018-11-30 11:34:17 [DEBUG   ] Got command RPT from MCS: ref #676876
2018-11-30 11:34:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676876  77 58452 41657361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:34:17 [DEBUG   ] Got command RPT from MCS: ref #676878
2018-11-30 11:34:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676878  12 58452 41657565 A  ERRORB–™š'
2018-11-30 11:34:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 11:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:34:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:34:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:34:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:34:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:34:25 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-30 11:34:43 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-30 11:35:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 11:35:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:35:24 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2018-11-30 11:35:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 11:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:35:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:35:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:35:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:35:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:35:25 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-30 11:35:44 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-11-30 11:35:50 [DEBUG   ] Got command RPT from MCS: ref #676886
2018-11-30 11:35:50 [DEBUG   ] summary = ERROR
2018-11-30 11:35:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676886  13 58452 41750001 A  ERRORERROR'
2018-11-30 11:35:50 [DEBUG   ] Got command RPT from MCS: ref #676887
2018-11-30 11:35:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:35:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676887  77 58452 41750002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:36:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:36:24 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2018-11-30 11:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-30 11:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 11:36:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:36:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:36:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:36:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:36:25 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-11-30 11:36:44 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-11-30 11:37:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:37:24 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2018-11-30 11:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:37:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:37:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:37:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:37:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:37:25 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-11-30 11:37:44 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-11-30 11:38:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 11:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:38:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 11:38:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:38:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:38:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:38:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:38:25 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-30 11:38:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 11:39:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-30 11:39:16 [DEBUG   ] Got command RPT from MCS: ref #676907
2018-11-30 11:39:16 [DEBUG   ] summary = ERROR
2018-11-30 11:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676907  13 58452 41956845 A  ERRORERROR'
2018-11-30 11:39:17 [DEBUG   ] Got command RPT from MCS: ref #676908
2018-11-30 11:39:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676908  77 58452 41957049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:39:17 [DEBUG   ] Got command RPT from MCS: ref #676909
2018-11-30 11:39:17 [DEBUG   ] summary = ERROR
2018-11-30 11:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676909  13 58452 41957241 A  ERRORERROR'
2018-11-30 11:39:17 [DEBUG   ] Got command RPT from MCS: ref #676910
2018-11-30 11:39:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676910  77 58452 41957445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:39:17 [DEBUG   ] Got command RPT from MCS: ref #676911
2018-11-30 11:39:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676911  12 58452 41957649 A  ERRORB˜™š'
2018-11-30 11:39:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:39:25 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-11-30 11:39:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:39:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:39:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:39:25 [WARNING ] (13, 1, 'bot')
2018-11-30 11:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:39:25 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-30 11:39:45 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-11-30 11:40:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-30 11:40:25 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-11-30 11:40:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:40:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:40:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:40:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:40:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:40:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:40:26 [DEBUG   ] Finished updating board flags in 2.196 seconds
2018-11-30 11:40:45 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-11-30 11:40:50 [DEBUG   ] Got command RPT from MCS: ref #676912
2018-11-30 11:40:50 [DEBUG   ] summary = ERROR
2018-11-30 11:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676912  13 58452 42050005 A  ERRORERROR'
2018-11-30 11:40:50 [DEBUG   ] Got command RPT from MCS: ref #676913
2018-11-30 11:40:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676913  77 58452 42050006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:41:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 11:41:25 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2018-11-30 11:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:41:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:41:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:41:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:41:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:41:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:41:26 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-30 11:41:45 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-11-30 11:42:06 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-30 11:42:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:42:26 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-30 11:42:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:42:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:42:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:42:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:42:26 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-30 11:42:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 11:43:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 11:43:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:43:26 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2018-11-30 11:43:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:43:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:43:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:43:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:43:26 [DEBUG   ] Finished updating board flags in 1.847 seconds
2018-11-30 11:43:46 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-11-30 11:44:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 11:44:16 [DEBUG   ] Got command RPT from MCS: ref #676935
2018-11-30 11:44:16 [DEBUG   ] summary = ERROR
2018-11-30 11:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676935  13 58452 42256933 A  ERRORERROR'
2018-11-30 11:44:17 [DEBUG   ] Got command RPT from MCS: ref #676936
2018-11-30 11:44:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676936  77 58452 42257125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:44:17 [DEBUG   ] Got command RPT from MCS: ref #676937
2018-11-30 11:44:17 [DEBUG   ] summary = ERROR
2018-11-30 11:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676937  13 58452 42257329 A  ERRORERROR'
2018-11-30 11:44:17 [DEBUG   ] Got command RPT from MCS: ref #676938
2018-11-30 11:44:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676938  77 58452 42257533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:44:17 [DEBUG   ] Got command RPT from MCS: ref #676940
2018-11-30 11:44:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676940  12 58452 42257725 A  ERRORB—™š'
2018-11-30 11:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:44:26 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-11-30 11:44:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:44:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:44:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:44:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:44:26 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-30 11:44:46 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-11-30 11:45:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:45:26 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-11-30 11:45:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:45:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:45:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:45:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:45:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:45:26 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-30 11:45:46 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-11-30 11:45:50 [DEBUG   ] Got command RPT from MCS: ref #676949
2018-11-30 11:45:50 [DEBUG   ] summary = ERROR
2018-11-30 11:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676949  13 58452 42350001 A  ERRORERROR'
2018-11-30 11:45:50 [DEBUG   ] Got command RPT from MCS: ref #676950
2018-11-30 11:45:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676950  77 58452 42350002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:46:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 11:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:46:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:46:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:46:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:46:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:46:26 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-11-30 11:46:27 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-30 11:46:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 11:47:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 11:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:47:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:47:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:47:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:47:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:47:26 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-30 11:47:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 11:47:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:48:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:48:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:48:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:48:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:48:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:48:26 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-11-30 11:48:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 11:48:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 11:49:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:49:17 [DEBUG   ] Got command RPT from MCS: ref #676970
2018-11-30 11:49:17 [DEBUG   ] summary = ERROR
2018-11-30 11:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676970  13 58452 42557013 A  ERRORERROR'
2018-11-30 11:49:17 [DEBUG   ] Got command RPT from MCS: ref #676971
2018-11-30 11:49:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676971  77 58452 42557217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:49:17 [DEBUG   ] Got command RPT from MCS: ref #676972
2018-11-30 11:49:17 [DEBUG   ] summary = ERROR
2018-11-30 11:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676972  13 58452 42557409 A  ERRORERROR'
2018-11-30 11:49:17 [DEBUG   ] Got command RPT from MCS: ref #676973
2018-11-30 11:49:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676973  77 58452 42557613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:49:17 [DEBUG   ] Got command RPT from MCS: ref #676974
2018-11-30 11:49:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676974  12 58452 42557817 A  ERRORB–™š'
2018-11-30 11:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:49:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:49:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:49:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:49:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:49:26 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-11-30 11:49:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 11:49:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 11:50:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 11:50:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:50:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:50:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:50:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:50:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:50:26 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-11-30 11:50:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:50:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:50:50 [DEBUG   ] Got command RPT from MCS: ref #676979
2018-11-30 11:50:50 [DEBUG   ] summary = ERROR
2018-11-30 11:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676979  13 58452 42650005 A  ERRORERROR'
2018-11-30 11:50:50 [DEBUG   ] Got command RPT from MCS: ref #676980
2018-11-30 11:50:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676980  77 58452 42650006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:51:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 11:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:51:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:51:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:51:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:51:26 [WARNING ] (13, 1, 'bot')
2018-11-30 11:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:51:26 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-11-30 11:51:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:51:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:52:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 11:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:52:27 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2018-11-30 11:52:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:52:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:52:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:52:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:52:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:52:27 [DEBUG   ] Finished updating board flags in 2.268 seconds
2018-11-30 11:52:47 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-11-30 11:53:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 11:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:53:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:53:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:53:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:53:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:53:27 [DEBUG   ] Finished updating board flags in 2.163 seconds
2018-11-30 11:53:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-30 11:53:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 11:54:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 11:54:17 [DEBUG   ] Got command RPT from MCS: ref #677002
2018-11-30 11:54:17 [DEBUG   ] summary = ERROR
2018-11-30 11:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677002  13 58452 42857093 A  ERRORERROR'
2018-11-30 11:54:17 [DEBUG   ] Got command RPT from MCS: ref #677003
2018-11-30 11:54:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677003  77 58452 42857297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:54:17 [DEBUG   ] Got command RPT from MCS: ref #677004
2018-11-30 11:54:17 [DEBUG   ] summary = ERROR
2018-11-30 11:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677004  13 58452 42857501 A  ERRORERROR'
2018-11-30 11:54:17 [DEBUG   ] Got command RPT from MCS: ref #677006
2018-11-30 11:54:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677006  77 58452 42857705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:54:17 [DEBUG   ] Got command RPT from MCS: ref #677007
2018-11-30 11:54:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677007  12 58452 42857897 A  ERRORB˜™š'
2018-11-30 11:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:54:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:54:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 11:54:28 [WARNING ] (13, 1, 'bot')
2018-11-30 11:54:28 [WARNING ] (13, 1, 'bot')
2018-11-30 11:54:28 [WARNING ] (13, 1, 'bot')
2018-11-30 11:54:28 [WARNING ] (13, 1, 'bot')
2018-11-30 11:54:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:54:28 [DEBUG   ] Finished updating board flags in 3.115 seconds
2018-11-30 11:54:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 11:55:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 11:55:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 11:55:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:55:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:55:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:55:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:55:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:55:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:55:27 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-11-30 11:55:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 11:55:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:55:50 [DEBUG   ] Got command RPT from MCS: ref #677012
2018-11-30 11:55:50 [DEBUG   ] summary = ERROR
2018-11-30 11:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677012  13 58452 42950005 A  ERRORERROR'
2018-11-30 11:55:50 [DEBUG   ] Got command RPT from MCS: ref #677013
2018-11-30 11:55:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677013  77 58452 42950006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:56:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-30 11:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:56:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:56:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:56:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:56:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:56:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:56:27 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-11-30 11:56:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 11:56:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 11:57:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 11:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:57:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:57:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:57:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:57:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:57:27 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-11-30 11:57:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 11:57:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 11:58:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 11:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:58:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:58:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:58:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:58:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:58:27 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-11-30 11:58:29 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2018-11-30 11:58:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 11:59:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:59:17 [DEBUG   ] Got command RPT from MCS: ref #677033
2018-11-30 11:59:17 [DEBUG   ] summary = ERROR
2018-11-30 11:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677033  13 58452 43157181 A  ERRORERROR'
2018-11-30 11:59:17 [DEBUG   ] Got command RPT from MCS: ref #677034
2018-11-30 11:59:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677034  77 58452 43157385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:59:17 [DEBUG   ] Got command RPT from MCS: ref #677035
2018-11-30 11:59:17 [DEBUG   ] summary = ERROR
2018-11-30 11:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677035  13 58452 43157589 A  ERRORERROR'
2018-11-30 11:59:17 [DEBUG   ] Got command RPT from MCS: ref #677036
2018-11-30 11:59:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 11:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677036  77 58452 43157793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 11:59:17 [DEBUG   ] Got command RPT from MCS: ref #677037
2018-11-30 11:59:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 11:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677037  12 58452 43157985 A  ERRORB—™š'
2018-11-30 11:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 11:59:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:59:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:59:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:59:27 [WARNING ] (13, 1, 'bot')
2018-11-30 11:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 11:59:27 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-30 11:59:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 11:59:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:00:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 12:00:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:00:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:00:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:00:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:00:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:00:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:00:28 [DEBUG   ] Finished updating board flags in 2.249 seconds
2018-11-30 12:00:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:00:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:00:50 [DEBUG   ] Got command RPT from MCS: ref #677042
2018-11-30 12:00:50 [DEBUG   ] summary = ERROR
2018-11-30 12:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677042  13 58452 43250001 A  ERRORERROR'
2018-11-30 12:00:50 [DEBUG   ] Got command RPT from MCS: ref #677043
2018-11-30 12:00:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677043  77 58452 43250002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:01:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 12:01:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:01:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:01:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:01:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:01:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:01:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:01:28 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-11-30 12:01:29 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 12:01:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:02:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:02:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:02:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:02:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:02:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:02:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:02:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:02:28 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-30 12:02:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 12:02:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 12:03:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 12:03:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:03:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:03:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:03:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:03:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:03:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:03:28 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-11-30 12:03:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-30 12:03:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:04:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:04:17 [DEBUG   ] Got command RPT from MCS: ref #677065
2018-11-30 12:04:17 [DEBUG   ] summary = ERROR
2018-11-30 12:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677065  13 58452 43457269 A  ERRORERROR'
2018-11-30 12:04:17 [DEBUG   ] Got command RPT from MCS: ref #677066
2018-11-30 12:04:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677066  77 58452 43457473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:04:17 [DEBUG   ] Got command RPT from MCS: ref #677067
2018-11-30 12:04:17 [DEBUG   ] summary = ERROR
2018-11-30 12:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677067  13 58452 43457677 A  ERRORERROR'
2018-11-30 12:04:17 [DEBUG   ] Got command RPT from MCS: ref #677069
2018-11-30 12:04:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677069  77 58452 43457869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:04:18 [DEBUG   ] Got command RPT from MCS: ref #677071
2018-11-30 12:04:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677071  12 58452 43458073 A  ERRORB–™š'
2018-11-30 12:04:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:04:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-30 12:04:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:04:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:04:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:04:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:04:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:04:28 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-30 12:04:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:04:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 12:05:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:05:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:05:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-30 12:05:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:05:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:05:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:05:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:05:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:05:28 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-11-30 12:05:30 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-11-30 12:05:50 [DEBUG   ] Got command RPT from MCS: ref #677079
2018-11-30 12:05:50 [DEBUG   ] summary = ERROR
2018-11-30 12:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677079  13 58452 43550009 A  ERRORERROR'
2018-11-30 12:05:50 [DEBUG   ] Got command RPT from MCS: ref #677080
2018-11-30 12:05:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677080  77 58452 43550010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:05:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:06:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 12:06:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:06:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 12:06:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:06:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:06:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:06:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:06:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:06:28 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-30 12:06:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:06:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:07:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 12:07:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 12:07:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:07:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:07:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:07:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:07:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:07:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:07:28 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-11-30 12:07:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 12:07:51 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-30 12:08:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 12:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:08:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:08:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:08:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:08:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:08:28 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-30 12:08:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 12:08:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:09:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:09:17 [DEBUG   ] Got command RPT from MCS: ref #677100
2018-11-30 12:09:17 [DEBUG   ] summary = ERROR
2018-11-30 12:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677100  13 58452 43757357 A  ERRORERROR'
2018-11-30 12:09:17 [DEBUG   ] Got command RPT from MCS: ref #677101
2018-11-30 12:09:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677101  77 58452 43757561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:09:17 [DEBUG   ] Got command RPT from MCS: ref #677102
2018-11-30 12:09:17 [DEBUG   ] summary = ERROR
2018-11-30 12:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677102  13 58452 43757753 A  ERRORERROR'
2018-11-30 12:09:17 [DEBUG   ] Got command RPT from MCS: ref #677103
2018-11-30 12:09:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677103  77 58452 43757957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:09:18 [DEBUG   ] Got command RPT from MCS: ref #677104
2018-11-30 12:09:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677104  12 58452 43758161 A  ERRORB˜™š'
2018-11-30 12:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:09:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:09:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:09:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:09:28 [WARNING ] (13, 1, 'bot')
2018-11-30 12:09:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:09:28 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-11-30 12:09:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 12:09:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 12:10:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:10:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:10:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:10:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:10:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:10:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:10:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:10:29 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-30 12:10:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:10:50 [DEBUG   ] Got command RPT from MCS: ref #677105
2018-11-30 12:10:50 [DEBUG   ] summary = ERROR
2018-11-30 12:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677105  13 58452 43850013 A  ERRORERROR'
2018-11-30 12:10:50 [DEBUG   ] Got command RPT from MCS: ref #677106
2018-11-30 12:10:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677106  77 58452 43850014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:10:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:11:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 12:11:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:11:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:11:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:11:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:11:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:11:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:11:29 [DEBUG   ] Finished updating board flags in 2.139 seconds
2018-11-30 12:11:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:11:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:12:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:12:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:12:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:12:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:12:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:12:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:12:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:12:29 [DEBUG   ] Finished updating board flags in 1.867 seconds
2018-11-30 12:12:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 12:12:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:13:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:13:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:13:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 12:13:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:13:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:13:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:13:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:13:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:13:29 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-11-30 12:13:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:13:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:14:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:14:17 [DEBUG   ] Got command RPT from MCS: ref #677128
2018-11-30 12:14:17 [DEBUG   ] summary = ERROR
2018-11-30 12:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677128  13 58452 44057437 A  ERRORERROR'
2018-11-30 12:14:17 [DEBUG   ] Got command RPT from MCS: ref #677129
2018-11-30 12:14:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677129  77 58452 44057641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:14:17 [DEBUG   ] Got command RPT from MCS: ref #677130
2018-11-30 12:14:17 [DEBUG   ] summary = ERROR
2018-11-30 12:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677130  13 58452 44057845 A  ERRORERROR'
2018-11-30 12:14:18 [DEBUG   ] Got command RPT from MCS: ref #677132
2018-11-30 12:14:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677132  77 58452 44058037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:14:18 [DEBUG   ] Got command RPT from MCS: ref #677133
2018-11-30 12:14:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677133  12 58452 44058241 A  ERRORB—™š'
2018-11-30 12:14:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:14:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:14:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:14:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:14:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:14:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:14:29 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-30 12:14:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:14:51 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 12:15:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 12:15:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:15:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:15:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:15:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:15:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:15:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:15:29 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-30 12:15:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 12:15:50 [DEBUG   ] Got command RPT from MCS: ref #677142
2018-11-30 12:15:50 [DEBUG   ] summary = ERROR
2018-11-30 12:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677142  13 58452 44150140 A  ERRORERROR'
2018-11-30 12:15:50 [DEBUG   ] Got command RPT from MCS: ref #677143
2018-11-30 12:15:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677143  77 58452 44150141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:15:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 12:16:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-30 12:16:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:16:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:16:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:16:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:16:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:16:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:16:29 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-11-30 12:16:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-30 12:16:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 12:17:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 12:17:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:17:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:17:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:17:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:17:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:17:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:17:29 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-30 12:17:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 12:17:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:18:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:18:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:18:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:18:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:18:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:18:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:18:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:18:29 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-30 12:18:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:18:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 12:19:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 12:19:17 [DEBUG   ] Got command RPT from MCS: ref #677163
2018-11-30 12:19:17 [DEBUG   ] summary = ERROR
2018-11-30 12:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677163  13 58452 44357529 A  ERRORERROR'
2018-11-30 12:19:17 [DEBUG   ] Got command RPT from MCS: ref #677164
2018-11-30 12:19:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677164  77 58452 44357733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:19:17 [DEBUG   ] Got command RPT from MCS: ref #677165
2018-11-30 12:19:17 [DEBUG   ] summary = ERROR
2018-11-30 12:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677165  13 58452 44357925 A  ERRORERROR'
2018-11-30 12:19:18 [DEBUG   ] Got command RPT from MCS: ref #677166
2018-11-30 12:19:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677166  77 58452 44358129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:19:18 [DEBUG   ] Got command RPT from MCS: ref #677167
2018-11-30 12:19:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677167  12 58452 44358333 A  ERRORB•™š'
2018-11-30 12:19:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:19:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:19:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:19:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:19:29 [WARNING ] (13, 1, 'bot')
2018-11-30 12:19:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:19:29 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-11-30 12:19:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:19:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:20:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 12:20:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:20:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 12:20:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:20:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:20:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:20:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:20:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:20:30 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-11-30 12:20:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 12:20:50 [DEBUG   ] Got command RPT from MCS: ref #677172
2018-11-30 12:20:50 [DEBUG   ] summary = ERROR
2018-11-30 12:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677172  13 58452 44450017 A  ERRORERROR'
2018-11-30 12:20:50 [DEBUG   ] Got command RPT from MCS: ref #677173
2018-11-30 12:20:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677173  77 58452 44450018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:20:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 12:21:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 12:21:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:21:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:21:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:21:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:21:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:21:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:21:30 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-30 12:21:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 12:21:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 12:22:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:22:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:22:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:22:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:22:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:22:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:22:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:22:30 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-30 12:22:33 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-30 12:22:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:23:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:23:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:23:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:23:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:23:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:23:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:23:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:23:30 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 12:23:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-30 12:23:53 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-30 12:24:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:24:17 [DEBUG   ] Got command RPT from MCS: ref #677195
2018-11-30 12:24:17 [DEBUG   ] summary = ERROR
2018-11-30 12:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677195  13 58452 44657609 A  ERRORERROR'
2018-11-30 12:24:17 [DEBUG   ] Got command RPT from MCS: ref #677196
2018-11-30 12:24:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677196  77 58452 44657813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:24:18 [DEBUG   ] Got command RPT from MCS: ref #677197
2018-11-30 12:24:18 [DEBUG   ] summary = ERROR
2018-11-30 12:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677197  13 58452 44658017 A  ERRORERROR'
2018-11-30 12:24:18 [DEBUG   ] Got command RPT from MCS: ref #677199
2018-11-30 12:24:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677199  77 58452 44658209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:24:18 [DEBUG   ] Got command RPT from MCS: ref #677201
2018-11-30 12:24:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677201  12 58452 44658413 A  ERRORB˜™š'
2018-11-30 12:24:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:24:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:24:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:24:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:24:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:24:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:24:30 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-30 12:24:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:24:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:25:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:25:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 12:25:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:25:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:25:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:25:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:25:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:25:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:25:30 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-11-30 12:25:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 12:25:50 [DEBUG   ] Got command RPT from MCS: ref #677205
2018-11-30 12:25:50 [DEBUG   ] summary = ERROR
2018-11-30 12:25:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677205  13 58452 44750013 A  ERRORERROR'
2018-11-30 12:25:50 [DEBUG   ] Got command RPT from MCS: ref #677206
2018-11-30 12:25:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:25:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677206  77 58452 44750014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:25:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:26:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 12:26:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:26:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:26:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:26:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:26:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:26:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:26:30 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-11-30 12:26:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-30 12:26:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 12:27:14 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2018-11-30 12:27:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:27:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:27:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:27:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:27:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:27:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:27:30 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-11-30 12:27:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:27:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:28:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:28:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:28:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:28:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:28:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:28:30 [WARNING ] (13, 1, 'bot')
2018-11-30 12:28:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:28:30 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-30 12:28:34 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-30 12:28:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-30 12:29:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:29:17 [DEBUG   ] Got command RPT from MCS: ref #677226
2018-11-30 12:29:17 [DEBUG   ] summary = ERROR
2018-11-30 12:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677226  13 58452 44957701 A  ERRORERROR'
2018-11-30 12:29:17 [DEBUG   ] Got command RPT from MCS: ref #677227
2018-11-30 12:29:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677227  77 58452 44957905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:29:18 [DEBUG   ] Got command RPT from MCS: ref #677228
2018-11-30 12:29:18 [DEBUG   ] summary = ERROR
2018-11-30 12:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677228  13 58452 44958097 A  ERRORERROR'
2018-11-30 12:29:18 [DEBUG   ] Got command RPT from MCS: ref #677229
2018-11-30 12:29:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677229  77 58452 44958301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:29:18 [DEBUG   ] Got command RPT from MCS: ref #677230
2018-11-30 12:29:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677230  12 58452 44958505 A  ERRORB—™š'
2018-11-30 12:29:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:29:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:29:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:29:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:29:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:29:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:29:31 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-11-30 12:29:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:29:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 12:30:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-30 12:30:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:30:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:30:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:30:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:30:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:30:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:30:31 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-30 12:30:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:30:50 [DEBUG   ] Got command RPT from MCS: ref #677235
2018-11-30 12:30:50 [DEBUG   ] summary = ERROR
2018-11-30 12:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677235  13 58452 45050009 A  ERRORERROR'
2018-11-30 12:30:50 [DEBUG   ] Got command RPT from MCS: ref #677236
2018-11-30 12:30:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677236  77 58452 45050010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:30:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 12:31:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 12:31:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:31:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:31:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:31:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:31:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:31:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:31:31 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-11-30 12:31:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-30 12:31:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-30 12:32:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:32:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:32:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:32:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:32:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:32:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:32:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:32:31 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-11-30 12:32:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:32:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 12:33:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:33:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 12:33:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:33:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:33:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:33:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:33:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:33:31 [DEBUG   ] Finished updating board flags in 1.638 seconds
2018-11-30 12:33:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 12:33:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 12:34:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:34:17 [DEBUG   ] Got command RPT from MCS: ref #677258
2018-11-30 12:34:17 [DEBUG   ] summary = ERROR
2018-11-30 12:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677258  13 58452 45257789 A  ERRORERROR'
2018-11-30 12:34:17 [DEBUG   ] Got command RPT from MCS: ref #677259
2018-11-30 12:34:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677259  77 58452 45257981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:34:18 [DEBUG   ] Got command RPT from MCS: ref #677260
2018-11-30 12:34:18 [DEBUG   ] summary = ERROR
2018-11-30 12:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677260  13 58452 45258185 A  ERRORERROR'
2018-11-30 12:34:18 [DEBUG   ] Got command RPT from MCS: ref #677262
2018-11-30 12:34:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677262  77 58452 45258389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:34:18 [DEBUG   ] Got command RPT from MCS: ref #677263
2018-11-30 12:34:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677263  12 58452 45258593 A  ERRORB–™š'
2018-11-30 12:34:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 12:34:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:34:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:34:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:34:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:34:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:34:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:34:31 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-30 12:34:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 12:34:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:35:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:35:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:35:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:35:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:35:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:35:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:35:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:35:31 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-30 12:35:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:35:50 [DEBUG   ] Got command RPT from MCS: ref #677272
2018-11-30 12:35:50 [DEBUG   ] summary = ERROR
2018-11-30 12:35:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677272  13 58452 45350017 A  ERRORERROR'
2018-11-30 12:35:50 [DEBUG   ] Got command RPT from MCS: ref #677273
2018-11-30 12:35:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:35:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677273  77 58452 45350018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:35:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:36:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:36:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:36:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:36:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:36:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:36:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:36:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:36:31 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-11-30 12:36:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:36:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:37:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:37:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-30 12:37:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:37:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 12:37:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:37:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:37:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:37:31 [WARNING ] (13, 1, 'bot')
2018-11-30 12:37:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:37:31 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-11-30 12:37:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:37:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:38:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:38:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 12:38:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:38:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:38:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:38:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:38:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:38:32 [DEBUG   ] Finished updating board flags in 2.265 seconds
2018-11-30 12:38:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:38:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:39:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:39:17 [DEBUG   ] Got command RPT from MCS: ref #677293
2018-11-30 12:39:17 [DEBUG   ] summary = ERROR
2018-11-30 12:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677293  13 58452 45557865 A  ERRORERROR'
2018-11-30 12:39:18 [DEBUG   ] Got command RPT from MCS: ref #677294
2018-11-30 12:39:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677294  77 58452 45558069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:39:18 [DEBUG   ] Got command RPT from MCS: ref #677295
2018-11-30 12:39:18 [DEBUG   ] summary = ERROR
2018-11-30 12:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677295  13 58452 45558273 A  ERRORERROR'
2018-11-30 12:39:18 [DEBUG   ] Got command RPT from MCS: ref #677296
2018-11-30 12:39:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677296  77 58452 45558477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:39:18 [DEBUG   ] Got command RPT from MCS: ref #677297
2018-11-30 12:39:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677297  12 58452 45558669 A  ERRORB˜™š'
2018-11-30 12:39:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:39:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:39:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:39:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:39:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:39:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:39:32 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-11-30 12:39:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:39:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:40:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 12:40:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:40:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:40:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:40:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:40:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:40:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:40:32 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-30 12:40:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:40:50 [DEBUG   ] Got command RPT from MCS: ref #677298
2018-11-30 12:40:50 [DEBUG   ] summary = ERROR
2018-11-30 12:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677298  13 58452 45650017 A  ERRORERROR'
2018-11-30 12:40:50 [DEBUG   ] Got command RPT from MCS: ref #677299
2018-11-30 12:40:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677299  77 58452 45650018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:40:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:41:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:41:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:41:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:41:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:41:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:41:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:41:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:41:32 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-30 12:41:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 12:41:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:42:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:42:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:42:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:42:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:42:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:42:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:42:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:42:32 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-11-30 12:42:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 12:42:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 12:43:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-30 12:43:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:43:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:43:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:43:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:43:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:43:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:43:32 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-30 12:43:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:43:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 12:44:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:44:17 [DEBUG   ] Got command RPT from MCS: ref #677321
2018-11-30 12:44:17 [DEBUG   ] summary = ERROR
2018-11-30 12:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677321  13 58452 45857953 A  ERRORERROR'
2018-11-30 12:44:18 [DEBUG   ] Got command RPT from MCS: ref #677322
2018-11-30 12:44:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677322  77 58452 45858157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:44:18 [DEBUG   ] Got command RPT from MCS: ref #677323
2018-11-30 12:44:18 [DEBUG   ] summary = ERROR
2018-11-30 12:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677323  13 58452 45858361 A  ERRORERROR'
2018-11-30 12:44:18 [DEBUG   ] Got command RPT from MCS: ref #677325
2018-11-30 12:44:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677325  77 58452 45858553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:44:18 [DEBUG   ] Got command RPT from MCS: ref #677326
2018-11-30 12:44:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677326  12 58452 45858757 A  ERRORB—™š'
2018-11-30 12:44:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:44:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:44:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:44:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:44:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:44:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:44:32 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-11-30 12:44:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:44:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:45:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 12:45:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:45:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:45:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:45:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:45:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:45:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:45:32 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-11-30 12:45:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:45:50 [DEBUG   ] Got command RPT from MCS: ref #677335
2018-11-30 12:45:50 [DEBUG   ] summary = ERROR
2018-11-30 12:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677335  13 58452 45950021 A  ERRORERROR'
2018-11-30 12:45:50 [DEBUG   ] Got command RPT from MCS: ref #677336
2018-11-30 12:45:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:45:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677336  77 58452 45950022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:45:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:46:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:46:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:46:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:46:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:46:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:46:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:46:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:46:32 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-11-30 12:46:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 12:46:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:47:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:47:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:47:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 12:47:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:47:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:47:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:47:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:47:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:47:32 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-30 12:47:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:47:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:48:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:48:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:48:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:48:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:48:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:48:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:48:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:48:32 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-30 12:48:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:48:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:49:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 12:49:18 [DEBUG   ] Got command RPT from MCS: ref #677356
2018-11-30 12:49:18 [DEBUG   ] summary = ERROR
2018-11-30 12:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677356  13 58452 46158041 A  ERRORERROR'
2018-11-30 12:49:18 [DEBUG   ] Got command RPT from MCS: ref #677357
2018-11-30 12:49:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677357  77 58452 46158245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:49:18 [DEBUG   ] Got command RPT from MCS: ref #677358
2018-11-30 12:49:18 [DEBUG   ] summary = ERROR
2018-11-30 12:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677358  13 58452 46158449 A  ERRORERROR'
2018-11-30 12:49:18 [DEBUG   ] Got command RPT from MCS: ref #677359
2018-11-30 12:49:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677359  77 58452 46158641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:49:18 [DEBUG   ] Got command RPT from MCS: ref #677360
2018-11-30 12:49:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677360  12 58452 46158845 A  ERRORB–™š'
2018-11-30 12:49:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:49:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:49:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:49:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:49:32 [WARNING ] (13, 1, 'bot')
2018-11-30 12:49:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:49:32 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-30 12:49:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 12:49:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-30 12:50:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 12:50:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:50:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:50:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:50:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:50:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:50:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:50:33 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-11-30 12:50:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-30 12:50:50 [DEBUG   ] Got command RPT from MCS: ref #677365
2018-11-30 12:50:50 [DEBUG   ] summary = ERROR
2018-11-30 12:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677365  13 58452 46250017 A  ERRORERROR'
2018-11-30 12:50:50 [DEBUG   ] Got command RPT from MCS: ref #677366
2018-11-30 12:50:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677366  77 58452 46250018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:50:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:51:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 12:51:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:51:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:51:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:51:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:51:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:51:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:51:33 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-30 12:51:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-30 12:51:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:52:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:52:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:52:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:52:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:52:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:52:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:52:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:52:33 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-30 12:52:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:52:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-30 12:53:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:53:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:53:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 12:53:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:53:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:53:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:53:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:53:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:53:33 [DEBUG   ] Finished updating board flags in 1.707 seconds
2018-11-30 12:53:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:53:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:54:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:54:18 [DEBUG   ] Got command RPT from MCS: ref #677388
2018-11-30 12:54:18 [DEBUG   ] summary = ERROR
2018-11-30 12:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677388  13 58452 46458129 A  ERRORERROR'
2018-11-30 12:54:18 [DEBUG   ] Got command RPT from MCS: ref #677389
2018-11-30 12:54:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677389  77 58452 46458333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:54:18 [DEBUG   ] Got command RPT from MCS: ref #677390
2018-11-30 12:54:18 [DEBUG   ] summary = ERROR
2018-11-30 12:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677390  13 58452 46458525 A  ERRORERROR'
2018-11-30 12:54:18 [DEBUG   ] Got command RPT from MCS: ref #677392
2018-11-30 12:54:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677392  77 58452 46458729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:54:18 [DEBUG   ] Got command RPT from MCS: ref #677394
2018-11-30 12:54:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677394  12 58452 46458933 A  ERRORB—™š'
2018-11-30 12:54:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:54:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:54:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:54:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:54:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:54:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:54:33 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-11-30 12:54:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 12:54:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 12:55:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 12:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:55:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:55:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:55:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:55:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:55:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:55:33 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-11-30 12:55:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 12:55:50 [DEBUG   ] Got command RPT from MCS: ref #677398
2018-11-30 12:55:50 [DEBUG   ] summary = ERROR
2018-11-30 12:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677398  13 58452 46550017 A  ERRORERROR'
2018-11-30 12:55:50 [DEBUG   ] Got command RPT from MCS: ref #677399
2018-11-30 12:55:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677399  77 58452 46550018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:55:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:56:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:56:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-30 12:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:56:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:56:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:56:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:56:33 [WARNING ] (13, 1, 'bot')
2018-11-30 12:56:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:56:33 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-11-30 12:56:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:56:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-30 12:57:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 12:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:57:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:57:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:57:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:57:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:57:34 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-11-30 12:57:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 12:57:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 12:58:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 12:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:58:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:58:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:58:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:58:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:58:34 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-11-30 12:58:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 12:58:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:59:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 12:59:18 [DEBUG   ] Got command RPT from MCS: ref #677419
2018-11-30 12:59:18 [DEBUG   ] summary = ERROR
2018-11-30 12:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677419  13 58452 46758217 A  ERRORERROR'
2018-11-30 12:59:18 [DEBUG   ] Got command RPT from MCS: ref #677420
2018-11-30 12:59:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677420  77 58452 46758409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:59:18 [DEBUG   ] Got command RPT from MCS: ref #677421
2018-11-30 12:59:18 [DEBUG   ] summary = ERROR
2018-11-30 12:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677421  13 58452 46758613 A  ERRORERROR'
2018-11-30 12:59:18 [DEBUG   ] Got command RPT from MCS: ref #677422
2018-11-30 12:59:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 12:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677422  77 58452 46758817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 12:59:19 [DEBUG   ] Got command RPT from MCS: ref #677423
2018-11-30 12:59:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 12:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677423  12 58452 46759021 A  ERRORB˜™š'
2018-11-30 12:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 12:59:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:59:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:59:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:59:34 [WARNING ] (13, 1, 'bot')
2018-11-30 12:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 12:59:34 [DEBUG   ] Finished updating board flags in 2.132 seconds
2018-11-30 12:59:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 12:59:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 13:00:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 13:00:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:00:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 13:00:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:00:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:00:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:00:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:00:34 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-11-30 13:00:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 13:00:50 [DEBUG   ] Got command RPT from MCS: ref #677428
2018-11-30 13:00:50 [DEBUG   ] summary = ERROR
2018-11-30 13:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677428  13 58452 46850029 A  ERRORERROR'
2018-11-30 13:00:50 [DEBUG   ] Got command RPT from MCS: ref #677429
2018-11-30 13:00:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677429  77 58452 46850030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:00:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 13:01:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 13:01:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:01:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:01:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:01:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:01:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:01:34 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-11-30 13:01:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-30 13:01:58 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-11-30 13:02:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-30 13:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:02:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:02:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:02:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:02:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:02:34 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-11-30 13:02:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-30 13:02:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 13:03:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:03:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:03:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 13:03:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:03:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:03:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:03:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:03:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:03:34 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-30 13:03:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:03:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 13:04:18 [DEBUG   ] Got command RPT from MCS: ref #677451
2018-11-30 13:04:18 [DEBUG   ] summary = ERROR
2018-11-30 13:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677451  13 58452 47058297 A  ERRORERROR'
2018-11-30 13:04:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 13:04:18 [DEBUG   ] Got command RPT from MCS: ref #677452
2018-11-30 13:04:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677452  77 58452 47058501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:04:18 [DEBUG   ] Got command RPT from MCS: ref #677453
2018-11-30 13:04:18 [DEBUG   ] summary = ERROR
2018-11-30 13:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677453  13 58452 47058705 A  ERRORERROR'
2018-11-30 13:04:18 [DEBUG   ] Got command RPT from MCS: ref #677455
2018-11-30 13:04:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677455  77 58452 47058897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:04:19 [DEBUG   ] Got command RPT from MCS: ref #677457
2018-11-30 13:04:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 13:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677457  12 58452 47059101 A  ERRORB—™š'
2018-11-30 13:04:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:04:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:04:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:04:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:04:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:04:34 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-30 13:04:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 13:04:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 13:05:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 13:05:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:05:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:05:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:05:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:05:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:05:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:05:34 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-30 13:05:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 13:05:50 [DEBUG   ] Got command RPT from MCS: ref #677465
2018-11-30 13:05:50 [DEBUG   ] summary = ERROR
2018-11-30 13:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677465  13 58452 47150029 A  ERRORERROR'
2018-11-30 13:05:50 [DEBUG   ] Got command RPT from MCS: ref #677466
2018-11-30 13:05:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677466  77 58452 47150030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:05:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 13:06:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 13:06:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:06:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:06:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:06:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:06:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:06:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:06:34 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-11-30 13:06:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 13:06:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-30 13:07:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-30 13:07:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:07:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:07:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:07:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:07:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:07:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:07:34 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-30 13:07:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-30 13:07:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 13:08:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:08:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:08:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:08:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:08:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:08:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:08:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:08:34 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-30 13:08:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:08:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 13:09:18 [DEBUG   ] Got command RPT from MCS: ref #677486
2018-11-30 13:09:18 [DEBUG   ] summary = ERROR
2018-11-30 13:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677486  13 58452 47358386 A  ERRORERROR'
2018-11-30 13:09:18 [DEBUG   ] Got command RPT from MCS: ref #677487
2018-11-30 13:09:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677487  77 58452 47358589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:09:18 [DEBUG   ] Got command RPT from MCS: ref #677488
2018-11-30 13:09:18 [DEBUG   ] summary = ERROR
2018-11-30 13:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677488  13 58452 47358793 A  ERRORERROR'
2018-11-30 13:09:18 [DEBUG   ] Got command RPT from MCS: ref #677489
2018-11-30 13:09:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677489  77 58452 47358985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:09:19 [DEBUG   ] Got command RPT from MCS: ref #677490
2018-11-30 13:09:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 13:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677490  12 58452 47359189 A  ERRORB—™š'
2018-11-30 13:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:09:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:09:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:09:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:09:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:09:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:09:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:09:34 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-11-30 13:09:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-30 13:09:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 13:10:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 13:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:10:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-30 13:10:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:10:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:10:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:10:34 [WARNING ] (13, 1, 'bot')
2018-11-30 13:10:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:10:34 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-11-30 13:10:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 13:10:50 [DEBUG   ] Got command RPT from MCS: ref #677491
2018-11-30 13:10:50 [DEBUG   ] summary = ERROR
2018-11-30 13:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677491  13 58452 47450025 A  ERRORERROR'
2018-11-30 13:10:50 [DEBUG   ] Got command RPT from MCS: ref #677492
2018-11-30 13:10:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677492  77 58452 47450026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:10:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 13:11:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-30 13:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:11:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:11:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:11:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:11:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:11:35 [DEBUG   ] Finished updating board flags in 2.259 seconds
2018-11-30 13:11:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 13:11:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 13:12:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-30 13:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:12:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:12:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:12:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:12:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:12:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:12:35 [DEBUG   ] Finished updating board flags in 2.119 seconds
2018-11-30 13:12:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-30 13:13:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-30 13:13:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 13:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:13:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:13:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:13:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:13:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:13:35 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-30 13:13:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 13:14:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 13:14:18 [DEBUG   ] Got command RPT from MCS: ref #677514
2018-11-30 13:14:18 [DEBUG   ] summary = ERROR
2018-11-30 13:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677514  13 58452 47658469 A  ERRORERROR'
2018-11-30 13:14:18 [DEBUG   ] Got command RPT from MCS: ref #677515
2018-11-30 13:14:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677515  77 58452 47658673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:14:18 [DEBUG   ] Got command RPT from MCS: ref #677516
2018-11-30 13:14:18 [DEBUG   ] summary = ERROR
2018-11-30 13:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677516  13 58452 47658877 A  ERRORERROR'
2018-11-30 13:14:19 [DEBUG   ] Got command RPT from MCS: ref #677518
2018-11-30 13:14:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677518  77 58452 47659069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:14:19 [DEBUG   ] Got command RPT from MCS: ref #677520
2018-11-30 13:14:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 13:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677520  12 58452 47659274 A  ERRORB˜™š'
2018-11-30 13:14:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-30 13:14:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:14:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:14:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:14:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:14:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:14:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:14:35 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-11-30 13:14:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:15:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-30 13:15:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 13:15:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:15:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:15:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:15:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:15:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:15:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:15:35 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-30 13:15:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 13:15:50 [DEBUG   ] Got command RPT from MCS: ref #677528
2018-11-30 13:15:50 [DEBUG   ] summary = ERROR
2018-11-30 13:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677528  13 58452 47750033 A  ERRORERROR'
2018-11-30 13:15:50 [DEBUG   ] Got command RPT from MCS: ref #677529
2018-11-30 13:15:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677529  77 58452 47750034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:16:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 13:16:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 13:16:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:16:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:16:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:16:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:16:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:16:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:16:35 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-30 13:16:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-30 13:17:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-30 13:17:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 13:17:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:17:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 13:17:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:17:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:17:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:17:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:17:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:17:35 [DEBUG   ] Finished updating board flags in 1.641 seconds
2018-11-30 13:17:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 13:18:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-30 13:18:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-30 13:18:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:18:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:18:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:18:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:18:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:18:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:18:35 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-30 13:18:41 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-30 13:19:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-30 13:19:18 [DEBUG   ] Got command RPT from MCS: ref #677549
2018-11-30 13:19:18 [DEBUG   ] summary = ERROR
2018-11-30 13:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677549  13 58452 47958561 A  ERRORERROR'
2018-11-30 13:19:18 [DEBUG   ] Got command RPT from MCS: ref #677550
2018-11-30 13:19:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677550  77 58452 47958753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:19:18 [DEBUG   ] Got command RPT from MCS: ref #677551
2018-11-30 13:19:18 [DEBUG   ] summary = ERROR
2018-11-30 13:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677551  13 58452 47958957 A  ERRORERROR'
2018-11-30 13:19:19 [DEBUG   ] Got command RPT from MCS: ref #677552
2018-11-30 13:19:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677552  77 58452 47959161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:19:19 [DEBUG   ] Got command RPT from MCS: ref #677553
2018-11-30 13:19:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 13:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677553  12 58452 47959353 A  ERRORB—™š'
2018-11-30 13:19:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-30 13:19:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:19:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:19:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:19:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:19:35 [WARNING ] (13, 1, 'bot')
2018-11-30 13:19:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:19:35 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-30 13:19:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-30 13:20:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-30 13:20:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-30 13:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:20:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:20:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:20:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:20:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:20:36 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-11-30 13:20:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-30 13:20:50 [DEBUG   ] Got command RPT from MCS: ref #677558
2018-11-30 13:20:50 [DEBUG   ] summary = ERROR
2018-11-30 13:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677558  13 58452 48050025 A  ERRORERROR'
2018-11-30 13:20:50 [DEBUG   ] Got command RPT from MCS: ref #677559
2018-11-30 13:20:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677559  77 58452 48050026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:21:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 13:21:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-30 13:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:21:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 13:21:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:21:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:21:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:21:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:21:36 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-11-30 13:21:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-30 13:22:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-30 13:22:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-30 13:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:22:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:22:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:22:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:22:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:22:36 [DEBUG   ] Finished updating board flags in 2.189 seconds
2018-11-30 13:22:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-30 13:23:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-30 13:23:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-30 13:23:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 13:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-30 13:23:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:23:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:23:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:23:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:23:36 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-11-30 13:23:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-30 13:24:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-30 13:24:18 [DEBUG   ] Got command RPT from MCS: ref #677581
2018-11-30 13:24:18 [DEBUG   ] summary = ERROR
2018-11-30 13:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677581  13 58452 48258637 A  ERRORERROR'
2018-11-30 13:24:18 [DEBUG   ] Got command RPT from MCS: ref #677582
2018-11-30 13:24:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677582  77 58452 48258841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:24:19 [DEBUG   ] Got command RPT from MCS: ref #677583
2018-11-30 13:24:19 [DEBUG   ] summary = ERROR
2018-11-30 13:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677583  13 58452 48259045 A  ERRORERROR'
2018-11-30 13:24:19 [DEBUG   ] Got command RPT from MCS: ref #677585
2018-11-30 13:24:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-30 13:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677585  77 58452 48259249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-30 13:24:19 [DEBUG   ] Got command RPT from MCS: ref #677586
2018-11-30 13:24:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-30 13:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677586  12 58452 48259441 A  ERRORB–™š'
2018-11-30 13:24:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-30 13:24:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-30 13:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-30 13:24:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:24:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:24:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:24:36 [WARNING ] (13, 1, 'bot')
2018-11-30 13:24:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-30 13:24:36 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-11-30 13:24:41 [DEBUG   ] Finished updating ant stats in 0.398 seconds
